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FURTHER STUDIES ON THE MATHEMATICAL THEORY OF 
INTERACTION OF INDIVIDUALS IN A SOCIAL GROUP 


N. RASHEVSKY 
THE UNIVERSITY OF CHICAGO 


A type of interaction of two active groups is considered, in 
which the opposition of each group increases as the success of the 
—— Some possible applications of this situation are dis- 
cussed. 


In previous papers (1, 2, 3, 4) we have studied various cases of 
interactions of groups of individuals based on different assumptions 
as to their behavior. In this paper we shall consider a still different 
case, which presents some interest. We pre-suppose the knowledge of 
the previous papers by the reader. The notations and terminology are 
essentially the same. 

Let us consider a case of interaction of two active groups, of such 
a nature that each group opposes the behavior of the other the more 
strongly the greater the success of that other group. This success may 
naturally be measured by the product of two factors: the ratio of the 
number of passive individuals which exhibit a given behavior to the 
total number of passives and the average intensity of that behavior. 
Let the average intensity of behavior A be denoted by w,. Then the 
total success of class A will be expressed by a,w,x/N’ where a, is a 
coefficient; or putting 


,W4— Ee, (1) 


that success will be measured by ex/N’. Similarly, if wg denotes the 
average intensity of behavior B , then the success is given by a,wgy/N'’ 
or, putting 
0.Wz = &’, (2) 

by e'y/N’. 

How to measure the quantities w, and wz is another question. 
We shall just consider the whole problem in abstracto and then give 
some possible concrete illustrations. 

In accordance with the foregoing assumptions and using the same 
procedure as before (1, 3), we put 
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y 


A, = a*(1 + ey? ? 


(3) 


x 
Co— Cy (1 + ean). 


The first expression in (3) shows that the effort of class A increases 
as the success of class B increases. The second expression shows a 
corresponding thing for class B . 


We now have 


ENS EO il 4 we 
a wo ear) Xo ax — c*o( Ea) Yo ay, (4) 
or, because of 
zr+y=N’, (5) 
after rearrangements 
dx Lo Yo 
7 (2a — a* oe’ yo CoE wo” 
(6) 


Xo 
+ [ (a* oe’ N’ oe: a) N'’ + BsLo a C*oYo] e 


The value of x tends asymptotically to 
Got’ Xo — GN" + O'oXo — C'Mo ¥ 
c= > (7) 
* , Xo * Yo 
Q o€ Ht Cot ap — 20 
and is positive under similar assumptions as made before (1, 3). A 
similar expression is obtained for y and therefore 





x a €' Xo —=—s aN' + Q’Xo ia iad Coo 














-= ‘ 8 
Y —C*o€Yo — AN’ + 0° 6Yo — "Xo (8) 
Equation (8) may be written: 
; Xo aN’ 
(a* e + a*,) a = (c’o + ) 
x Yo 0 
toa aN’ —? (9) 
(c*e + c%) — )-a*,— 
Yo Yo 
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which is of the form 
Xo 
- A z —B 
sth cman (10) 
C— a’, oe 


Here A > 0 and B > 0. Since, with the above-mentioned assumption, 
x and y are both non-negative, therefore C > 0. When 2/Y. = C/a*, 
then x/y = ©, in other words x = N’, y= 0 and all of the passive 
population exhibit behavior A with an average intensity w,. If Yo 
is fixed, the requirement x = N’ gives 


Lo = Cy, /a*y. (11) 


But C, is a linear function of ¢ = a,w,. Hence, the stronger the aver- 
age intensity of activity A, the greater for a given y., must be 2» 
in order to impress that activity on the whole passive population. If 
for a given 2%, w, is too great, then the denominator of (10) will be 
positive and «/y will be finite, hence x < N’. If all the coefficients in 
our equations were known, then from a given maximum intensity w, 
of behavior A which still can be imposed on all the passive individuals 
we could calculate x, for a known y% . 

We shall denote by wm the maximum value of w, which still can 
be impressed on the whole passive population. Correspondingly we 
shall put em = aWam. For a given Xo and Yo, €ém is determined as the 
root of equation (11). 

Let us now consider a simplified case, in which wz = 0 and there- 
fore « = 0. This means that group A merely resists the behavior A 
but does not tend to impose any qualitatively different behavior B . In 


that case 


7 














Xo 
-—- (c*, + ) 
x Yo Yo 
-= . ; (12) 
a Xo 
(c*oe ss Cu aca ) aes * 
Yo Yo 
In order to have x = N’, or x/y = © , we must have 
nF Rc (1 + em) 13) 
ao =—C Em . 
0 Yo Yo 0 ( 


Suppose now that the same group of 2, active individuals tries to im- 
pose another behavior of intensity w, on the passive population. Let 
this time that behavior A, be opposed by a different group of Yo: = aYo 
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other active individuals, the coefficients of influence remaining the 
same. Then, denoting by x, and y, the number of passive individuals 
that correspondingly exhibit and do not exhibit behavior A, , we have 
an expression similar to (12), in which ¢, is put instead of ¢, and ayy 
instead of y.. Introducing (13) into that expression, we find, after 
elementary calculations: 








ac*,(1 + 2,) — c°o(1 + em) 
Ce gull ta) ~ielly 450 
which is of the form 
Yr A’ Ea B'em 
= : (15) 





t+Y. ‘6 


Let us discuss a case considered in a previous paper (3), namely 
that of two active classes I and II, and a passive class III. Let again 
class I represent the “controlling” or “governing class” and let x 
refer to it. Class II again is the one that organizes the production of 
goods. We have discussed in loc. cit. some cases of interaction of two 
such classes, when class I requires a certain amount of goods pro- 
duced by classes II and III to be surrendered to it. Here we shall con- 
sider the situation from a somewhat different point of view. Class I 
may require that every individual of class II and III gives a certain 
fraction of everything he produces to class I. Class II will oppose it, 
the opposition being the stronger, the greater the fraction required. 
Thus that fraction may be used as a measure of w,. Class I will im- 
pose as high a wy,,, as can be impressed on the whole population, 
and that fraction will be the larger, the larger x,. In practice we may 
take as an illustration for wy, the ratio of the governmental tax re- 
ceipts to the total national income. 

If we consider the case of very small a, then equations (10), 
(13), and (14) become simplified, their coefficient not containing y, . 
In particular, because of (1), equation (13) now becomes of the form 


Lo 
—= A" + B’wWan, (16) 


Yo 
while (15) becomes 
Yr a, ‘iniii B” Wam 


+% wre 





Ascribing to w,, the meaning above, we may try to check equation 
(16), if we have some other means of determining x,/y,. The fol- 
lowing gives a very rough possible estimate of that ratio. Most of the 
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active population of a country is concentrated in cities. The stronger 
the “governing” class I, the more centralized the government and the 
larger the relative size of the capital city. Denoting by N, the popu- 
lation of the capital and by N, the total urban population, we may 
consider roughly 
Lo N-. 
Yo Nu-Ne’ 


Assuming that for different countries, the coefficients A” and B” are 
the same, which is of course only an extremely rough approximation, 
we shall expect 


(18) 


ce © A” + B’Wam. (19) 
Data of W4m are scarce and inaccurate (5). Using what is available, 
the result of comparison of equation (19) with observation is shown 
in Figure 1, with data valid about 1930. 








wome=- CALCULATED woe- CALCULATED 
| —o— OBSERVED 20} = OBSERVED 


RELATIVE CR 
Ss 


Nc/(Nu-Ne) 























FIGURE 1 FIGURE 2 


It must also be kept in mind that the whole discussion is based 
upon considerations of steady equilibrium states. A sudden increase 
Of Wam Will not result in an immediate variation of N./(N, — N.-), 
recording to equation (19). There will be considerable time lags gov- 
erned by the general differential equation (4), in which w, and hence 
é are made explicit functions of time. 


Equation (17) may be used for estimating the success of impos- 
ing other behaviors by x,, in terms of Wim. The governing class re- 
quires certain standards of behavior in different lines of life, the re- 
quirements being put into effect with different amounts of effort for 
different types of behavior. Deviations from the required behavior 
constitute crimes of various degrees. Thus equation (17) may be used 
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to study comparative criminality in different populations, for 


Yi/(%1 + Y) 


denotes the ratio of individuals that do not obey the dictates of class 
I. y, here denotes the total number of criminals, while y,: would de- 
note the active ones. It will be agreed that a large number of crimes 
are committed by passive individuals, as a result of imitation, etc. 

Criminal statistics are in themselves not very accurate and are 
hardly comparable for different countries due to different legal stand- 
ards (5). The most comparable would be perhaps the incidence of 
such obviously criminal acts as murders. An important factor, how- 
ever, has to be added in that case to equation (17). Other conditions, 
including x/Yo: , being the same, there will be a difference in the in- 
cidence of crime depending on the ease with which a crime is or can 
be hidden. The latter depends on the density of population d. This 
function f(d) of d is a rather complicated one. Obviously f(d) must 
be zero for d = 0, since no crimes are committed in an unpopulated 
country. Yet beginning with rather small values of d, f(d) must 
within a certain range of d’s decrease with d , approximately as 1/d. 
For the greater the density of population, the larger the nv mber of in- 
dividuals a crime affects, and the sooner it becomes known. A murder 
of an individual living alone in a secluded spot may remain undiscov- 
ered for weeks. As d increases further, however, this also increases 
the ease with which the criminal can hide himself after the deed. 
Thus f(d) must start at zero, reach a maximum, decrease approxi- 
mately as 1/d, and then again increase. This latter increase is likely 
to be a factor of increased crime incidence in large cities, although a 
concentration of the active elements in cities, mentioned above, un- 
doubtedly plays an important part, too. The density of population in 
large cities is of the order of 10‘ individuals per square kilometer or 
higher. The highest population densities in countries as a whole are 
about 300-400 individuals per square kilometer. Thus it is plausible 
to assume that the increase of f(d) begins only over values of d of 
the order of 10° individuals per square kilometer. In identifying 
y,/(x, + y,) with the incidence of murders CR , we will multiply the 
right side of (17) by 1/d. The results given by the simple expres- 
sion 

ae Wim 
Ck =>———__, (20) 
d 

where D is a constant, are shown in comparison with observation in 
Figure 2. 
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We may consider a still different type of behavior, which is not 
forbidden by class I, but is not too much encouraged. As an example 
we may cite divorce. If y,/(2, + y:), which we now identify with the 
divorce rate, DR, is very small, in other words y,; << x, , we may sub- 
stitue for y:/(%, + y,) simply y,/z,. For that ratio we have an 
expression of the same form as (10), namely, 


team ae (21) 


where again y»; is the number of active individuals advocating di- 
vorces. As before, we have yo: = ay. When y,/z, is small, then we 
may expand the right side of (21) and stop at the linear term. Thus 
we obtain 

Gi- 9 i Yo = 

DR=—=A—-—B. (22) 

X, Lo 
Combining (22) with (18) we find a relation between y,/z, and (Ny — 
N.)/N-, which is illustrated in Figure 3.* 





conn CALCULATED 
———— OBSERVED 


g 


OR PER 100.000 PER YEAR 
3 3 
Tt 














It must be emphasized that the foregoing illustrations do not 
mean any “confirmation” of a particular theory. They merely serve 
to illustrate how, starting from purely theoretical abstract concepts, 


*In the illustration in Figure 1 of equation (19), W,,, for the United States 
was taken as the ratio of the total federal tax receipts to the national income. 
Accordingly, the population of Washington D. C. was taken for N,. Considering 
that, due to the decentralized system of the United States Government, such reg- 
ulations as concern divorces are more of a state nature, in the computations for 
Figure 3 by means of equations (22) and (18), N, is taken as representing the 
sum of populations of all state capitals. 
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we may gradually arrive at relations that can be tested by observa- 
tion. To speak of actual verifications of any such theory would re- 
quire much more elaboration of the theory, which must take inio ac- 
count many more complex factors. The illustrations show, however, 
how certain relations may be suggested even by an inadequate theory, 
which thus helps us to notice such relations. For we usually notice 
only what we look for, and we lsok for things which we expect. 
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USE OF THE TEST SCORING MACHINE AND THE GRAPHIC 
ITEM COUNTER FOR STATISTICAL WORK 


BENJAMIN S. BLOOM AND ARDIE LUBIN 
BOARD OF EXAMINATIONS, THE UNIVERSITY OF CHICAGO 


The graphic item-counter is described and its use as a statistical 
device is explained. Procedures are presented for obtaining Pearson 
product-moment correlations by means of the graphic item-counter. 


The Test Scoring Machine developed by the International Busi- 
ness Machines Corporation is designed to secure by electrical means 
the score made by an individual who has marked an answer sheet 
according to the directions given in a test. A recently developed spe- 
cial device for this machine is the Graphic Item Counter. This attach- 
ment prints a graphic record of the pencil marks appearing in prede- 
termined positions on a group of answer sheets. These graphs fur- 
nish the data necessary for item analysis, questionnaire analysis, and 
many requirements of response counting where original records may 
take the form of marks in particular positions on a machine-scored 
answer sheet. 

The Graphic Item Counter has 90 counting positions. It is 
equipped with a plugboard which has one plugging position for each 
of the 750 response positions on the standard answer sheet or record 
form. It also has one plugging position for each of the 90 counting 
positions. Any response position may be connected to any counter by 
means of a plugwire. 

To make an analysis of the marks on an answer sheet, the desired 
response positions are wired to the desired counters by means of the 
plugboard arrangement. The answer sheets are then passed through 
the machine. As each answer sheet passes through the machine, the 
marks are scanned and where a mark occurs in the proper position, 
the appropriate counter will register one. When the last answer sheet 
of the group has been passed through the machine, a graphic item 
count record sheet is inserted into the machine with a carbon paper 
over it. A starting lever is turned and the carriage automatically runs 
the sheet through the machine and prints on it a bar graph of the 
item count. The bars for each of the items project vertically so that 
the top mark in each column represents, by its position, the number 


233 











234 PSYCHOMETRIKA 


counted for that item. There are also two total counters which count 
the number of sheets run through the machine. 

It is the purpose of this paper to describe a few of the possible 
uses of this machine for statistical work, with special reference to a 
method whereby the machine can be used for the computation of tables 
of intercorrelations. This machine can count as many as 90 marks at 
a time on a single answer sheet. Since about 500 papers can be passed 
through the machine in a single hour, it is possible to secure about 
45,000 counts per hour. Such rapid counting should prove of great 
value in facilitating the computation of many of the statistical formu- 
las common in education and psychology. This machine can be used 
for much of the statistical work which can be performed by the use 
of Hollerith or punch-card equipment. 


Coding 

An answer sheet may be used to record an individual’s answers 
to a test or questionnaire. But, an answer sheet may also be used to 
record other types of information about a person or group. Since the 
answer sheet has 750 positions and each position may be used in the 
recording of information, a vast amount of information about a sin- 
gle individual or group may be placed on an answer sheet. 

The following illustration may make clear some of the possibil- 
ities. If it is desired to indicate that John Doe is male, white, 14 
years of age, and in the 8th year of school, and that he has a score 
of 30 on Arithmetic achievement, a score of 13 on Reading Aptitude, 
and an average grade of B, this may be recorded as shown in the illus- 
tration. 

John Doe is a male, and since in our coding arrangement the 
male occupies the first response position on the answer sheet, that 
position has been blackened. Since John Doe is white, the first re- 
sponse position in the second row has been blackened. The geometric 
code is explained in the note. John’s average grade is a B, and since 
B occupies the second position in the coding arrangement, the answer 
sheet has been blackened in the row corresponding to average grade 
as indicated above. Information about other individuals like John 
Doe might be coded in a similar fashion on other answer sheets. 

After the information has been placed on the answer sheet, it is 
possible to pass the answer sheets through the machine and to deter- 
mine the frequency with which each characteristic is present for an 
entire group of individuals. When a geometric or other code is used, 
it is possible to determine the frequency of each coded mark on the 
answer sheet and then to translate the coded marks back to the origi- 
nal characteristics. 
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Characteristic Coding Arrangement Answer Sheet Form 





scsss Ww 
2 


2 
1. Sex 1: Male 2. Female 1 4 
1 


ws: 
23 Ss, 


232 > ma > GE bE b> WO > :::: 


2. Color 2. White 2.Negro 3. Other 2§ 


1 
3. Age Geometric code* 3 i 
1 


4, Arithmetic Achievement 4 # 


: 
5. Reading Aptitude 5 4 
1 


6. School Year 6 
- 2 
7, Average grade 1A 2B 3C 4D 5.F 7 # t 








* Geometric code: Such a code utilizes a series such as 1, 2, 4, 8, 16, 32, etc. 
to represent a numerical value. Any value up to 31 may be represented by one 
number or by a combination of the numbers in the series 1,2,4,8,16. For example, 
the age 14 in the illustration above may be represented by the 2,4, and 8. We 
have used the five response positions of the answer sheet to indicate this series, so 
the age 14 was coded by blackening the 2nd, 3rd, and 4th positions which repre- 
sent the 2nd, 8rd, and 4th numbers in the series. The value 30, which is the 
Arithmetic Achievement score, would be represented by the combination of 2,4,8, 
and 16, or the 2nd, 3rd, 4th, and 5th positions of the answer sheet. This geo- 
metric code and its uses have been treated in: Royer, E. B., and Toops, H. A., 
Statistics of geometrically coded scores, J. Amer. Stat. Assoc., 1933, 28, 192-198. 


If the individual answer sheets are sorted into groups on the 
basis of any desired characteristic such as sex, age, etc., a count and 
comparison can be made between the various groups for any data 
which have been coded onto the answer sheets. 


Adding 

Since any counting process is really an adding operation, this 
machine can be used for many tasks which involve addition. Adding 
may be done as follows: 

1. If it is desired to add one column of marks to another, the 
length of each can be measured with a scale and the total 
length may be read in terms of the total number of marks or 
total frequency. 

Length of column, + length of column, = length of columns 
1 + 2= total number of marks in columns 1 and 2. 
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2. If the marks represent coded scores, the length of each column 
of marks on the graphic item count may be interpreted in 
terms of the appropriate unit or scale, and the summing of the 
desired columns will yield the total sum. 


Length of column, X appropriate unit + length of column, 
X appropriate unit = total sum. 


Subtraction 

The difference between the heights of two columns when read on 
a scale in terms of the appropriate unit will yield the result of the 
subtraction of one from the other. 


Length of column, — length of column, = difference in num- 
ber of marks in columns 1 and 2. 


Multiplication 
1. If it is desired to multiply one column by a certain number, a 
scale in terms of that unit may be placed beside the column 
and the height of the column when read on the scale will yield 
the desired sum. 
Length of column, X< appropriate unit = product. 


2. It is also possible by the proper wiring of the plugboard and 
the use of the Multiple Response Unit to determine the fre- 
quency with which one mark on the answer sheet occurs con- 
currently with another mark. The height of the appropriate 
column may be read on a scale marked in terms of Unit, X 


Unit. . 


Tetrachoric correlations 

The basic frequencies for a series of tetrachoric correlations may 

be obtained in the following ways: 

1. The frequency with which A, and A, occur simultaneously may 
be obtained for as many as 90 interrelationships by wiring the 
plugboard so that A, and A, are wired to one counter, A; and 
A, are wired to another counter, etc., and the Multiple Re- 
sponse switch is turned on. A count will be made when each 
pair of marks occurs. When all the papers are passed through 
the machine, a graphic record will be produced, where each 
column represents the frequency with which each combination 
has occurred. Each column will represent the frequency in 
one cell of a four-fold distribution. The other cells can be de- 
termined by a knowledge of the totals for each row and col- 
umn of the distribution. For example: 
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2 4 
A B A B 
A 25 70 A 30 50 
1 3 
B 30 B 50 
40 60 100 45 55 100 


2. The answer sheets may be sorted into the A and B positions 
or piles for variable 1, and the frequency with which A, oc- 
curs with A., A;, Ay, +++, Ago may be determined by appro- 
priate wiring and passing the answer sheets through the ma- 






































chine. 
2 3 
A B A B 
1 1 
Rp 30 B 30 
40 60 100 50 50 100 


By the methods above, tetrachoric correlations may be computed 
between items, or between coded characteristics already placed on the 
answer sheet. 

Product-Moment Correlations 
Steps in Coding Scores 

Product-moment correlations may be computed from data sup- 
plied by the Graphic Item Counter, when it is desired to secure all the 
intercorrelations for a large number of variables. The following steps 
may be followed: 

1. Translate raw scores into step intervals. Sixteen or fewer 

step intervals represent a convenient division. 

2. Convert step intervals to a geometric code using the numbers 

1-2-4-8, e.g.: 
A score of 13 would be represented by the numbers 1-4-8; 


A score of 7 would be represented by the numbers 1-2-4; 
A score of 4 would be represented by the number 4. 
3. For each individual use a 5-response answer sheet, 
letting response no. 1 = 1 of the code, 
letting response no. 2 = 2 of the code, 
letting response no. 3 = 4 of the code, 
letting response no. 4 = 8 of the code; 
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and allowing each question number to represent a variable, thus: 


question no. 1 = variable 1, 
question no. 2 = variable 2, 
question no. 3 = variable 3. 
Thus the scores of John Smith on a number of tests might be 


coded onto the answer sheet by the following steps: 


Variable Step 

Variable Number Score Interval Code Answer Sheet 
ly Re oes Ss 
Intelligence 1 86 15 1-2-4-8 { ] i i f Hf 
a ee So $ 
Arithmetic 2 29 7 1-2-4 24 { 38 
: @rees 4 5 
Spelling 3 54 14 1-2-8 3] i HH I ! 
English 4 36 8 8 ‘22% s 
Ngiis. oe 3 te Hy 
. Ai bo: 


Steps in Operation of Graphic Item Counter 
4, Plug the Graphic Item Counter plugboard so that: 


Variable I—Response 1 is wired to counter 1, 
Response 2 is wired to counter 2, 
Response 3 is wired to counter 3, 
Response 4 is wired to counter 4. 
Variable II—Response 1 is wired to counter 5, 
Response 2 is wired to counter 6, 
Response 3 is wired to counter 7, 
Response 4 is wired to counter 8. 


Continue this until 
Variable XXII—Response 4 is wired to counter 88, 

5. Divide the papers for the entire group of individuals on the 
basis of response positions blackened for Variable I. Select all 
answer sheets which have response No. 1 blackened for Vari- 
able I. This is done regardless of any other marks on this 
variable. 

6. Run these papers through the graphic item counter and print 
the record which results from this process. Label this graph, 
Variable I, Code 1. 

7. Place papers used in step 6 with other papers, and then select 
all answer sheets which have response No. 2 blackened for 
Variable I. This is done regardless of any other marks on this 
variable. 











10. 


11. 


12. 


13. 
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. Repeat Step 6 for these papers and label the graph, Variable 


I, Code 2. 


. Repeat steps 7 and 8 for each response position on Variable I. 


Label results from response position 3, Variable I, Code 4. 
Label results from response position 4, Variable I, Code 8. 


Repeat steps 5 through 9 for each variable, thus obtaining four 
graphs for each variable, one for each geometric code number 
used. 


Steps in Securing Sums and Sums of Cross-Products 
From Graphic Item Counter Record 


In a table similar to Table 1, copy the results from each graphic 
item counter record. Thus Variable I, Code 1 would be entered 
in row no. 1; Variable I, Code 2 would be entered in row no. 2. 
Continue this process until all rows have been filled. Thus each 
graph record corresponds to a row in this table. 

Each entry in the cells should be multiplied by the row and 
column code numbers for which it forms the intersection. For 
example, this may be performed for Variable I by multiplying 
appropriate entries in the first row by the column code num- 
bers 1, 2, 4, and 8. Enter the result in the appropriate cell in 
the column headed by a © sign for Variable I. Repeat this 
operation for rows 2, 3, and 4. Then multiply the sum for row 
1, Variable I by 1; row 2, Variable I by 2; row 3, Variable I 
by 4; and row 4, Variable I by 8. The resulting sum = >X,X, . 
When these steps are repeated for Variables II and III, the 
results will equal ©X,X, and >X,X;. In this table the sums 
of the cross products have been indicated by encircling.* 

To obtain SX for any variable, multiply the diagonal cell en- 
tries (the figures in parentheses) for each diagonal block by 
the appropriate column code numbers. The sum of the products 
for each diagonal block will be the >X for that variable. Thus 
in order to secure X, in this example: (1 X 82) + (2 X 105) 
+ (4X 98) + (8 X 91) = TX,= 1412. These >X’s have been 
placed at the top of the table. 


Note: The correlations may be computed using any of the 
standard formulas for Pearson Product-Moment correla- 
tions, for example: 





NSXY — SX SY 
r= rf 
VNSX?— (SX)? VNSY?— (SY)? 
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By this method it is possible for two clerks to compute 231 inter- 
correlations using 100 cases in about four working days, with every 
correlation computed twice using different basic figures. Accurate re- 
sults will be obtained if the original answer sheets are marked very 
carefully with heavy marks and all stray pencil marks are removed. 

* An alternative method for transforming geometric coded values to sums of 
cross products is given by Kuder, G. F. Use of the International Scoring Machine 


for the rapid computation of tables of intercorrelations, J. appl. Psychol, 1938, 
587-596. 
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ON DETERMINING THE RELIABILITY AND SIGNIFICANCE 
OF A TETRACHORIC COEFFICIENT OF CORRELATION* 


J. P. GUILFORD AND THOBURN C. LYONS 
UNIVERSITY OF SOUTHERN CALIFORNIA 


In this note are presented facilitating tables for the estimation 
of the standard error of a tetrachoric r and also tables providing 
significant and very significant tetrachoric coefficients for various 
sizes of samples and various combinations of proportions in the 
dichotomized distributions. 


The tetrachoric coefficient of correlation has been coming more 
and more into use in recent years, particularly since the Thurstone 
computing diagrams (1) are generally available. There is reason to 
believe that the popularity of this statistic will continue. It is im- 
portant, therefore, that consideration be given to the question of the 
reliability and the statistical significance of the tetrachoric r. 

The complete formula for estimating the standard error of this 
kind of coefficient is so forbidding in terms of labor that rarely does 
a textbook on statistics present it. And yet, because the standard error 
is so much larger than that for an ordinary Pearson r under similar 
circumstances, it is important that the research worker be aware of 
its magnitude when he computes a tetrachoric r. 

The present trend in sampling theory is to use the standard error 
rather than the probable error of an estimated parameter, so that 
practice will be observed here. According to Kelley (2), the standard 
error of a tetrachoric r is given by the formula 


Vpp'aq sin-'7 \2 
oo, => 1- = 72), 1 
yy VN ( 90° ) | ” “ 


in which p is the proportion of the cases in one of the two main cate- 
gories for one of the correlated variables, 








p’ is the similar proportion for the other variable, 
q=1-p,andq=1- 7, 
y and y’ are ordinates in the normal distributions of unit 


* The task of computing the values in the accompanying tables should be 
credited to Mr. Lyons. 
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area at the deviates which correspond to p and p’ re- 
spectively, 
r is the tetrachoric coefficient of correlation, 
and sin-'7 is the angle whose sin is equal to 7 .* 


For convenience in what follows we have envisaged this formula 
as being factored as follows: 


1 Vpq Vid in? \2 

Peete lee [)-Gae) ja-m. @ 
vi es #¥ 90 l 

Let us call the five factors A, B, C, D, and E, respectively. The 

equation then reads 





o-—A-B-C-VD-E. (3) 


It is our purpose to present, first, tabled values for factors B , C , and 
VDE which will facilitate decidedly the computation of o,. Similar 
tables for this purpose have appeared before, but not collectively or in 
complete form, and only then for the purpose of estimating PE’, rather 
than o, (2,3). Table 1 gives values for both B and C. Entering this 
Table with either p or q (whichever is .50 or larger) and then with 
p' or q’, we can read values of B and C. Table 2 provides values for 


the factor \/DE for values of r ranging from 0.00 to 0.99 in steps of 
0.01. Factor A is readily determined from general tables of square 
roots and reciprocals or by computation. The product of the four fac- 
tors yields o,. The use and interpretation of this estimated parameter 
is of course subject to the same restrictions and qualifications as in 
the case of any a,. 

Probably of greater utility in interpreting a coefficient of corre- 
lation is the practice of determining whether an r is far enough re- 
moved from zero to be indicative of a genuine correlation in the popu- 
lation from which the sample was drawn. The practice of computing 
o,, Which was discussed above, is based upon the assumption that the 
true 7, or population rv , is identical with the sample 7. Furthermore, 
as Fisher has often pointed out, the distribution of the sample 7’s is 
skewed when + is large so that the usual interpretations of the fluctua- 
tions of sample 7’s are sometimes most unsatisfactory. To the knowl- 
edge of the writers, there is no provision for translating a o of a tetra- 
choric r into terms of a z parameter which is symmetrically distrib- 
uted, as is true for the ordinary Pearson 7. The best solution, there- 
fore, seems to be the assumption of a null hypothesis. This means to 


* A misprint appearing in Kelley’s presentation of the formula has been cor- 
rected here. 
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suppose that the population correlation is actually zero and to com- 
pute o, to fit this assumption. A distribution of such sample 7’s would 
be symmetrical, and from the size of this o, and of the obtained co- 
efficient we can infer the probability that the null hypothesis is ten- 
able or untenable. 

In line with this discussion, we have adopted Fisher’s fiducial 
limits of 5 per cent and 1 per cent and Student’s distribution as bases 
of deciding whether a certain tetrachoric r is significant or very sig- 
nificant. An r is regarded as significant if for a sample of size N 
there is only 1 chance in 20 of obtaining an r as large or larger in 
random sampling from the same population. An r is regarded as very 
significant if there is only 1 chance in 100 of obtaining similarly an 
r that deviates that much or more from zero. We present in Table 3 
the significant tetrachoric r’s for various combinations of N and of 
p and p’. We present in Table 4, similarly, the very significant tetra- 
choric 7’s. To be specific, when N is 100, when p (or p’) is .6, and p’ 
(or p) is .5, it takes an r of at least 0.315 to be regarded as significant 
(see Table 3). An r as large as 0.315 or larger, either positive or 
negative, could occur simply by random sampling in an uncorrelated 
population 5 times in 100, when the size of sample is 100. For the 
same population and size of sample, Table 4 tells us that it would 
take an 7 of 0.417 to be regarded as very significant. Once in a hun- 
dred times a tetrachoric 7 as large as this or larger could occur when 
the true correlation is zero. 

In using Tables 3 and 4, there is a general rule that p and p’ are 
interchangeable. To take an example, from the column headed p = .9 
and p’ = .6, one can also find the significant (or very significant) r 
for the case in which p = .6 and p’ = .9. Assume that N = 250, p= .9 
and p’ = .6, and a significant 7 is 0.270 and a very significant one 
0.356. The same values of r would apply when p — .6 and p’ — .9. 

Another rule is that » and q are interchangeable. When » is less 
than .5, one must enter the table with q, which equals 1 — p. For 
example, if the obtained p is .2 and p’ is .4, in the table we look for 
p=.8 and p'=.6. To take another example, if p and p’ both equal .1, 
we look in the column headed p = .9 and p’ = .9. This type of replace- 
ment also holds when only one p is less than .5. For the combination 
p= .3 and p’ = .8, we would look for the heading p = .7 and p’ = .8. 
But since p is always greater than or equal to p’ in these particular 
tables, we look for p = .8 and p’ = .7. 

If the obtained proportions and values of N do not coincide with 
those offered in the tables, one may perform the necessary interpola- 
tions. It is doubtful whether the labor of interpolating is worth while 
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except when the obtained r is quite near the boundary line of signifi- 
cance, however. In other instances, one might be conservative by tak- 
ing the next smaller N than his sample contained, and by choosing p 
values nearer to 1.00 than the obtained ones. 

Inspection of Tables 3 and 4 shows that within their limits the 
significant 7’s range from 0.097 to 0.580, and very significant 7’s 
range from 0.128 to 0.767. These facts should impress one with the 
importance of working only with very large samples when a tetra- 
choric r is to be the index of correlation. Only then will o, be reason- 
ably small and will one be justified in rejecting the null hypothesis 
when r turns out to be small or even moderate in size. 
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Providing the Values for Factors B and C in Formula (2) 


J. P. GUILFORD AND THOBURN C. LYONS 


TABLE 1 


Corresponding to Various Values of p or q 
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Vpq Vpq Vpq q 
porg — porg —— porg — porg — 
y y y y 
50 1.2588 .60 1.2680 .70 1.8180 .80 1.4287 .90 1.7094 
51 1.2585 .61 1.2712 .71 1.8256 .81 1.4457 .91 1.7623 
52 1.2589 .62 1.2748 .72 1.8388 .82 1.4641 .92 1.8248 
58 1.2546 .68 1.2787 .73 1.8427 .88 1.4844 .93 1.9003 
54 1.2556 .64 1.28830 .74 1.8528 .84 1.5067 .94 1.9936 
55 1.2569 .65 1.2877 .75 1.8626 .85 1.5815 .95 2.1131 
56 1.2585 .66 1.2928 .76 1.87388 .86 1.5590 
57 1.2604 .67 21.2984 .77 1.8859 .87 1.5897 
58 1.2626 .68 1.8044 .78 1.8990 .88 1.6245 
59 1.2652 .69 1.8109 .79 1.413838 .89 1.6640 
TABLE 2 
Providing the Values for the Factor VDE in Equation (2) Corresponding 
to Different Values of the Tetrachoric r 
r VDE r VDE r VDE r VDE r VDE 
00 1.0000 .20 9717 .40 .8845 .60 -7297 .80 -4844 
01 .9998 21 .9687 41 .8784 61 .7199 81 4686 
02 .9997 22 -9657 42 .8723 .62 -7099 82 .4526 
03 .9994 .23 .9625 43 .8658 63 .6996 .83 4362 
04 .9988 24 .9591 44 .8594 64 .6892 84 4191 
05 .9982 .25 .9555 45 .8526 65 .6784 85 .4018 
06 .9975 .26 -9520 46 .8458 .66 .6675 .86 .8838 
07 .9966 27 -9483 AT .8388 67 -65638 87 .8652 
08  .9955 .28 .9442 48 .8314 .68 .6448 .88 3460 
09 -9942 .29 -9401 49 .8240 .69 -6331 .89 .3262 
10 = .9930 .80 .9358 .50 8165 -70 .6210 .90 .8057 
ll .9915 31 .9314 51 .8087 Bit -6087 91 -2844 
12 # .9899 32 .9268 52 .8007 By 5961 .92 .2620 
13 -9881 33 .9220 .53 -7926 -73 -5834 .93 -2387 
14 ~=.9862 34 9171 54 -7841 74 5702 94 .2142 
15 -9841 .35 -9122 55 -7755 75 -5569 -95 .1881 
16 9819 36 .9070 .56 -7669 -76 .5429 .96 .1606 
17 9795 ot -9016 57 -7579 whet 5288 97 .1805 
18 .9770 .38 .8961 .58 -7488 -78 .5145 .98 .0973 
19 9745 39 .8904 59 -7394 -79 .4995 99 -0586 
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TABLE 38 


Tetrachoric Coefficients of Correlation, Significant at the .05 Level, for 
Various Sizes of Sample and Combinations of p and p’ 











p=. 9 9 9 9 9 8 8 

N p= 9 8 7 6 5 8 7 
100 580 A85 AAT 430 425 405 374 
150 ATL 394 363 350 346 329 304 
200 ‘407 340 314 302 299 285 263 
250 364 304 281 270 267 254 .235 
300 332 277 256 246 243 232 214 
350 307 .257 237 228 225 .215 .198 
400 .287 .240 222 213 211 201 185 
500 .257 215 198 191 188 179 166 
600 234 196 181 174 172 164 151 
806 203 170 156 151 149 142 131 
1000 181 151 .140 134 133 127 117 
1500 .148 124 114 110 108 108 095 
2000 128 107 099 095 094 .089 083 
2500 115 096 088 £085 084 080 074 
3000 105 087 081 078 077 073 067 
5000 081 068 062 .060 .059 057 052 
10000 057 048 044 043 042 .040 037 








TABLE 3 (continued) 











p= +~«8 8 41 1 a 6 6 5 

NY te 6 5 sf 6 5 6 5 5 
100 .360 355 845 232 328 319 315 312 
150 .292 .289 .280 .270 .267 .259 .256 .253 
200 .253 .250 .242 233 .230 .224 222 .219 
250 .226 .223 .216 .208 .206 .200 198 196 
300 .206 .203 197 -190 188 183 181 .179 
350 190 188 183 .176 174 .169 167 165 
400 178 .176 171 164 .162 .158 .156 .154 
500 159 157 153 147 145 141 .140 .138 
600 145 144 139 134 133 129 128 .126 
800 .126 .124 -A21 116 115 112 110 .109 
1000 1%2 an 108 104 102 .100 .099 097 
1500 .092 091 .088 085 .084 081 .080 .080 
2000 .079 .079 .076 .073 .072 071 .070 .069 
2500 071 070 .068 .066 .065 063 062 .062 
3000 .065 .064 .062 .060 .059 .058 .057 .056 
5000 .050 .050 .048 .046 .046 .045 .044 .044 


|| 
as e471 65D DD RD bet be 





10000 036 035 034 033 032 032 031 .031 
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Various Sizes of Sample and Combinations of p and p’ 
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Tetrachoric Coefficients of Correlation, Significant at the .01 Level, for 








ae 




















p= 2D 9 9 9 9 8 8 
paz 8 be 6 5 8 PY | 
-767 641 592 569 563 536 494 
.622 .520 .480 462 .456 435 401 
537 .449 .414 399 .3894 375 .346 
.480 401 370 .356 352 2385 .309 
437 .365 837 824 821 805 .282 
404 .388 312 300 297 283 .261 
878 316 292 281 277 .264 .244 
29 .282 .260 251 .248 .236 .218 
308 .258 .238 .229 226 215 .199 
.267 223 .206 198 195 186 172 
.238 .199 184 ETT 175 .166 153 
194 163 .150 144 148 136 125 
.168 141 130 125 123 118 109 
151 126 .116 112 110 105 .097 
137 115 .106 102 101 .096 .089 
106 .089 .082 .079 .078 0.74 .069 
.075 .068 .058 .056 055 .053 .049 
TABLE 4 (continued) 
8 8 Py oe ot 6 
6 5 aa 6 5 5 
A76 470 456 439 434 422 417 
.386 381 370 .856 352 843 339 
8338 829 820 .307 304 .296 .292 
.298 294 .285 275 271 .264 .261 
By | .268 .260 .250 .247 .241 .238 
251 .248 .240 231 229 223 .220 
.234 202 225 .216 .214 .208 .206 
.209 .207 .201 198 191 186 184 
191 .189 .183 176 174 170 .168 
165 163 .158 152 151 147 145 
148 146 .142 136 185 131 .130 
424 119 .116 111 110 107 .106 
104 108 -100 096 .095 .093 091 
.093 .092 .099 .086 085 .083 .082 
.085 .084 .082 .079 .078 .076 .075 
.066 .065 .063 .061 .060 .059 .058 
.047 .046 .045 043 .043 .041 041 
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A FACTORIAL STUDY OF AUDITORY FUNCTION 


J. E. KARLIN 
UNIVERSITY OF CHICAGO 


Tests of auditory function in the fields of pitch, loudness, qual- 
ity (timbre), and time, auditory analysis, synthesis, and memory, 
together with age, intelligence, and four tests of visual memory, were 
studied factorially. The subjects were 200 high-school students. The 
intercorrelations were factored to nine factors by a modification of 
the centroid technique and rotated to an oblique simple structure. 
No general auditory factor appeared. Instead there appeared group 
factors tentatively identified as pitch-quality discrimination, loud- 
ness discrimination, “auditory integral for perceptual mass,” audi- 
tory resistance (synthesis and analysis), speed of closure, auditory 
span formation, memory span (auditory and visual), memory or in- 
cidental closure and an unidentifiable residual plane. The average 
intercorrelation among the primary vectors was low, only one inter- 
correlation being greater than .84. A number of queries are ans- 
wered by the interpretation of the results. 


I. Statement of the Problem 

Preliminary factorial investigation of parts of the auditory field 
(6) has indicated that individual differences in auditory proficiency 
can reasonably be supposed to arise from a structured matrix of fun- 
damental abilities. Although previous factorial studies have been ex- 
ploratory in purpose and small in extent, a satisfying amount of 
agreement has been demonstrated among the different studies. It 
was decided, therefore, to investigate the auditory field in greater de- 
tail; the result is the present study. The line of attack was derived 
mainly from two sources, (a) leads from previous factorial work and 
(b) experimental and clinical evidence. 

It has been established in previous analyses (6) that even when 
as few as six auditory tests were considered there was no general 
auditory factor. The low communalities of the tests had argued for 
a complex functional background. The evidence was thus all against 
the conventional clinical assumption that there was a strong general 
factor operative in various types of auditory situations; this factor 
was measured by an audiometer test. The clinical experience of the 
present writer had shown, furthermore, that except for cases of ex- 
treme deterioration of the auditory apparatus there frequently ex- 
isted significant discrepancies between audiometric measurements 
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and success of prediction of hearing of the spoken voice and other 
complex sounds in everyday acoustic situations. Two patients might 
have about the same auditory acuity as indicated by the audiometer 
but differ appreciably in their auditory ability as shown by their per- 
formance in a more complex auditory environments. The initial facets 
of the problem become then: 


1. Would a more extensive factorial investigation of auditory 
phenomena verify the failure to discover a general auditory factor 
in earlier exploratory minor studies? 

2. Is there any broad group factor which might be deemed a 
fair approximation to the general factor? 

3. To what extent does pitch and loudness discriminatory sensi- 
tivity predict response to social auditory stimuli? 


Together with the general factor assumption in audition, there 
has been a large amount of experimental activity based on what 
might be called the group-factor assumption in audition. This work 
has been carried out by the physicist investigating the properties of 
sound, the psycho-physiologist interested in general audition, the psy- 
chologist examining the auditory background of musical phenomena, 
and the clinical otologist furthering research in diagnosis of auditory 
pathology. For some idea of the prevailing evidence and theories con- 
cerning these types of auditory function reference should be made 
to the more modern texts in the field (1, 4, 7,11). 

All experimentalists agree in taking their start from the physical 
characteristics of the sound wave. The assumption is made that the 
physical characteristics of frequency, intensity, complexity, and dura- 
tion have four functionally-distinct corresponding types of auditory 
function in sense of pitch, sense of loudness, sense of timbre or qual- 
ity, and sense of time. This assumption does not appear to have been 
questioned either on theoretical or empirical grounds. 


Each of these four functionally distinct qualitative types of au- 
ditory function has been investigated experimentally with some thor- 
oughness. The manner of function of each of these variables has been 
described in some detail, both when the other three variables are held 
constant and when they are allowed to vary. In general, it is found 
that each function does not remain constant when the other three 
variables are influential. It should be noted that these four factors 
have not been demonstrated with any degree of rigor to be function- 
ally distinct; they have been asswmed distinct on the grounds that 
their physical counterparts are theoretically separable in the mathe- 
matical analysis of the sound wave. The psychology of hearing has in 
fact developed along rather unpsychological lines. Customarily, new 
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ideas in psychology spring from observation of behavior; only if 
known psychological techniques are inadequate for the furtherance 
of these ideas does it become necessary to seek methods of approach 
from other sciences. Here the process tended to be reversed. As a 
result there exists at the present time a substantial auditory literature 
on various so-called psychological entities with a foundation which 
is physical rather than psychological. 

Notwithstanding the great weight of experimentation on these 
four postulated primary auditory factors, it becomes apparent upon 
investigation that this experimental work has itself been based upon 
an increasing number of further assumptions. Each factorial name 
has been applied to a further series of auditory phenomena on theo- 
retical grounds. For instance, first the assumption is made that there 
is a pitch factor for pure tones; then the term pitch factor is applied 
to complex sounds, short sounds, vocal sounds, and so on. The same 
is true for sense of loudness. The relation between the various sub- 
functions of each major type of auditory function has not been dem- 
onstrated. 

At this point it is possible to mention some further aspects of the 
general problem in addition to the three already mentioned: 


4. Are there four distinct functional unities of the character of 
pitch, loudness, quality, and time? 

5. Can it be demonstrated that the various sub-functions of the 
categories pitch, loudness, quality, and time are sufficiently saturated 
with the dominant trait of that category to warrant the same psy- 
chological description for their essential character? 

The first step towards setting up the battery of auditory tests 
in accordance with the line of reasoning outlined above was to allow 
for the four domains in the auditory field demanded by tradition. In 
a factor analysis it is necessary to construct at least two tests in order 
to stabilize a factor in the common factor space. A number of tests 
were therefore constructed for each domain; such a procedure would 
appear to comply with the prerequisites for the investigation of as- 
pects 4 and 5 above. These domains are discussed in turn. 


Pitch Domain 


In the pitch domain were tests of pitch discrimination for pure 
tones (Test 1), for complex sounds (Test 2), for short-impulse pure 
tones (Test 3), and for vocal sounds (Test 4). It has been assumed 
that these are all based upon the same fundamental pitch function, 
although the empirical evidence for this assumption has not been 
forthcoming. The pitch of complex sounds has been difficult to meas- 
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ure either physically or psychophysically. In the present study an 
assumption has been made which has been shown valid in other 
branches of test-theory where a test is measuring systematic vari- 
ability within the range of ability of the subjects, namely: where two 
complex sounds do not differ in those characteristics which make it 
possible to assign them definite pitches, the judgments of a large 
enough random sample from the general population will be about 
equally divided in the comparison of the two pitches. Where the judg- 
ments of such a sample show a significant majority for a pitch differ- 
ence, the judgment of the majority can effectually be used as the cor- 
rect response. The scoring criterion for pitch discrimination for com- 
plex sounds was therefore taken as the significant judgment of the 
majority for each comparison item. At worst, if this scoring device 
is invalid for co-relating systematic variabilities, the test would not 
show up in the factorial domain and some other method would have 
to be devised to score such a test. To the extent that the test does 
correlate with other tests and does appear in the factorial framework, 
it must be conceded that this scoring device is valid. 

In the case of vocal sound pitch discrimination the scoring cri- 
terion was based on the experimental and psychophysical findings. In 
the study of speech dynamics it has been established that two vocal 
sounds may have the same fundamental frequency and yet be judged 
to possess different pitches. The conclusion has been that such dif- 
ferences are attributable to the complexity of overtones of the sounds. 
It would seem therefore that this test is equally well to be considered 
a test of quality discrimination and should have some projection in 
the quality domain. 

In the short-impulse pitch discrimination test it was considered of 
interest to discover what relationship there might exist between the 
duration threshold necessary for accurate pitch judgments and other 
forms of pitch judgments above the duration threshold. The corre- 
sponding problem was likewise investigated in the loudness domain. 


Loudness Domain 

This domain was determined by tests of loudness discrimination 
for pure tones (Test 5), for complex sounds (Test 6), for short-im- 
pulse pure tones (Test 7), and for the pitch-loudness function (Test 
8). Again it has been assumed that these are various aspects of the 
same basic loudness function and again the empirical verification is 
lacking. The difficulties in scoring a test of loudness discrimination 
for complex sounds are similar to those for complex pitch, especially 
as the complex stimuli are not sustained. The judgments of the ma- 
jority were again taken as indicating the correct responses. The 
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pitch-loudness function is a psycho-physiological phenomenon and has 
no known physical explanation. The function is plotted as the rela- 
tion of intensity threshold to frequency of pure tone stimuli. It turns 
out to be a function such that the extreme frequencies, high and low, 
require greater physical intensity to become audible (3, 12). In the 
present test loudness judgments are required for comparison of two 
tones of different frequency but the same intensity. It becomes of 
interest to discover whether individual differences in this function 
are functionally correlated with loudness differences or with pitch dif- 
ferences. Such a finding would be of immediate anatomical interest. 


Quality Domain 

It has already been hypothesized that the test of vocal pitch dis- 
crimination (Test 4) will have a projection in this domain. Any 
timbre or quality factor might reasonably be supposed to acquire fur- 
ther stabilizing projections from a number of tests in which the stim- 
uli are complex sounds. In particular the maximum projection would 
apparently come from the test for quality discrimination (Test 13). 


Time Domain 

The conventional distinction has been made between “filled time” 
and “unfilled time.” There does not appear to be any evidence on the 
underlying relation of these two aspects of the time sense. If there 
is a distinct factor analogous to sense of time, the two time tests 
(Test 9 and 10) employed here should bring it to light. 

The remainder of the problem emerges directly from the ques- 
tion: “To what extent may the results of laboratory tests of these 
four categories, employing relatively simple and meaningless stimuli, 
be deemed predictive of auditory behavior response in the more com- 
plex and meaningful social situations of spoken and musical sound?” 
As has been previously pointed out, this seemed to be the problem 
that clinicians had not as yet solved. 

The definition of the content and boundaries of the social audi- 
tory situation was the first source of concern in attempting a solu- 
tion of this aspect of the problem. It was necessary to review the 
auditory literature and to set up tests which could be considered a use- 
ful sample of the types of auditory function common to the conven- 
tional auditory social environment. The further auditory domains 
finally chosen with this condition in mind were: Rhythm, Auditory 
Analysis, Auditory Synthesis, and Auditory Memory. 


Rhythm Domain 
The rhythm factor is obviously important in a variety of audi- 
tory situations; specifically, mention might be made of the role 
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of rhythm in speech pathology and in the appreciation of musical 
progressions. An adequate picture of the past and present status of 
experimental work on rhythm may be obtained from a study of the 
publications of the University of Iowa group specializing in the psy- 
chology of music. The over-all view expressed there (8) is that the 
rhythmic sense “consists essentially in a tendency to group a succes- 
sion of auditory stimuli according to the relevant dynamics of time 
and stress.” Factorially, this might be expressed in the view that 
rhythm is a function of a time factor, a loudness factor, and specific 
factors. In the present case two tests of rhythm were used: motor 
rhythm (Test 11) and music rhythm (Test 12). 


Domain of Auditory Analysis 

By auditory analysis is meant the power of the auditory mech- 
anism to receive composite stimulation and to break down this com- 
plex sound into its component parts. In everyday life it is obvious 
that the ear is never subjected to any single, detached type of audi- 
tory stimulation. At any given time the ear is being literally bom- 
barded by a multifarious array of sounds; if all such stimuli could 
claim attention in proportion to their physical energy the auditory 
environment would be in a chaotic state. Orderliness and meaning- 
fulness are imposed by the selective power of the auditory centers so 
as to magnify psychologically the stimulating force of certain stimuli 
and diminish that of others in a manner somewhat independent of 
their physical energies. Thus normally only certain selected stimuli 
receive attention in consciousness. This problem of selection of audi- 
tory stimuli which are continually being obscured by other stimuli 
is typically investigated under the name of masking. By all accounts 
the field of masked phenomena is exceedingly intricate and the laws 
operating therein are a long way from being understood with any de- 
gree of comprehensiveness. The degree of factorial complexity of 
this domain and its relation to other auditory domains is still very 
much a matter for future investigation. 

It was hoped that this part of the auditory field would draw to 
it the projections of at least Tests 14-17. All these tests presented 
auditory tasks requiring the selection of given stimuli from complex 
auditory situations; the complexity would appear to be in large part 
a function of the different kinds of masking used. In Test 14 (Sound 
Breakdown) five simultaneous isolated voice-sounds were masking 
each other; in Test 15 (Pure Tone Masking) one pure tone was mask- 
ing a second pure tone; in Test 16 (Sensory Masking) the spoken 
voice was being masked by a continuous buzzing noise; in Test 17 (In- 
tellective Masking) one intermittent voice was being masked by a 
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second continuous voice. One essential difference between Tests 16 
and 17 would appear to be that in Test 16 the distracting sound is 
operative on the sensory level and has no meaning on higher levels; 
in Test 17 the distracting voice not only obscures the stimulus value 
of the primary voice but also competes for attention on more mean- 
ingful levels, especially since the content of the distracting speech is 
much more interesting than the content of the primary speech. 


Domain of Auditory Synthesis 

Distortion of the meaningfulness of sound in various contexts 
can occur also by processes other than those of masking. The distor- 
tion may arise from defects in the articulation of the vocal sound it- 
self even when the environmental conditions are otherwise favorable 
for auditory perception. The function of the ear permitting recep- 
tion and comprehension of auditory stimuli in spite of articulatory 
defects is implied in the term auditory synthesis. This may be de- 
fined as the ability to resist and compensate for sound temporally dis- 
torted. This type of distortion may take several forms: 

1. Alteration of the habitual rate of presentation of vocal sym- 
bols tends to nullify meaning. If vocal sounds follow one another in 
too rapid sequence, the auditory mechanism may be stimulated on a 
point for point basis but the message carried by the auditory tracts 
may remain uninterpretable at the center. Test 19 (Rapid Spelling) 
was constructed to illustrate this function. The letters’ of common 
words are spelled out rapidly, much in the manner adopted by two 
adults wishing to converse on topics not intended for the enlighten- 
ment of the younger family members present. In such cases much dif- 
ficulty is often experienced by the other adult in understanding the 
word spelled out. 

2. Intelligible speech requires a certain minimum standard of 
conventional modes of articulation. Undue changes in the pitch, loud- 
ness, duration, inflection, and similar factors exert inhibitory influ- 
ences against word-perception. Test 20 (Singing) and Test 21 (Hap- 
hazard Speech) appear to feature such factors. It is a familiar ob- 
servation that the words of a song are much more difficult to under- 
stand than the words of spoken speech. The artistic demands of the 
song-form require a dynamic system of the foregoing factors in ac- 
cordance with the nuances of the music and pay little attention to the 
intrinsic meaningfulness of the words themselves. The aesthetic qual- 
ities of the musical sounds are, furthermore, usually the more inter- 
esting to the listener and serve to raise the limen for verbal intel- 
ligibility. In Haphazard Speech the words of simple sentences are 
spoken with unconventional changes of the sort just mentioned. The 
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general effect is that of an extremely nervous public speaker who is 
in addition the unfortunate possessor of uncontrollable vocal cords. 

3. The rhythmic arrangement of words in meaningful phrases 
is a sine qua non of intelligible speech. Each idea or phrase automati- 
cally forms an auditory gestalt; destruction of such gestalts within 
the sentence rends the sentence void of utility. In Test 23 (Illogically 
Grouping) the phrase-gestalten were purposefully altered so as to 
necessitate the reconstructive power of the auditory process before 
words achieved their customary form. 


Domain of Auditory Memory 

It seems fairly clear that much of the meaning derived from au- 
ditory stimuli is normally possible only because of the ability of the 
organism to retain in memory a succession of such stimuli for suit- 
able interpretation. This ability is usually termed auditory memory. 
The amount of experimental literature reported on this topic is large 
but the quantity of evidence on the correlation of individual differ- 
ences in this connection is much smaller. The validity of even the 
small amount of the latter type of evidence is questionable. However, 
it was found in the preliminary studies which led the way to the pre- 
sent investigation (6) that memory tended to play a rather surpris- 
ingly important part factorially in auditory functions. 

Four tests of auditory memory were specifically designed to aug- 
ment the auditory memory common factor variance and to provide a 
framework for possible memory factors. These tests were: Memory 
for Female Voices (Test 24), Memory for Male Voices (Test 25), 
Tonal Memory (Test 26), and Memory for Emphasis (Test 27). 

The relation between auditory memory span and visual memory 
span is still controversial in spite of a great deal of evidence on this 
point. This lack of agreement might be due in part to the different 
contexts in which the span tests appeared. The factorial approach of 
a study such as the present one would at least indicate something of 
the nature of the relationship in so far as this relationship was based 
upon the factors sampled in the study. The more complete nature of 
the relationship would depend upon successive variations of the fac- 
torial context. In the present study, auditory memory span (Test 23) 
and visual memory span (Test 28) were used as a beginning towards 
the solution of this problem. 

At this point the formulation and discussion of the auditory prob- 
lem is really complete for present purposes. It was decided, however, 
to provide opportunity for evidence on two further subsidiary aspects 
of the same problem, namely, reading and speech disabilities, and vis- 
ual memory functions. In some reading and speech disability cases 
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it is possible to demonstrate gross impairment of hearing; in other 
cases hearing for all frequencies appears normal but the sounds of 
different vowels and consonants cannot be discriminated. It was 
thought that this latter type of difficulty might be due to a defect of 
some more complex auditory function. Test 18 (Vowels-Consonants 
Discrimination) was therefore included. 


Domain of Visual Memory 

Factorially, very little is known about the relationship between 
auditory and visual memory functions. Precise knowledge on this 
point would require a separate factor analysis; in the present study 
it was decided to include a few tests of visual memory which had pre- 
viously been shown to be relatively independent of content (15). Such 
tests might be considered to typify more the visual process involved 
in memory rather than the material memorized. It was hoped that 
even such a few tests, if they were of the sort described, might be the 
first steps towards the solution of the problem of the relationship be- 
tween auditory and visual memory functions and the establishment 
of a framework which could exist as a guide for future work. These 
tests were: Visual Memory Span (Test 28), already mentioned, Mem- 
ory for Geometrical Drawings (Test 29), Memory for Boys’ Faces 
(Test 30), and Memory for Limericks (Test 31). Because of its social 
implications, the correlation between Memory for Boys’ Faces (Test 
30) and Memory for Male Voices( Test 25) was awaited with partic- 
ular interest. 

Finally, the variables of Age (Test 32) and Intelligence Quo- 
tient (Test 33) were included to make some determination of the ef- 
fects of biological growth on the response of the auditory mechanism 
and mental growth on the more complicated social responses in the 
auditory environment. 


The Final Problem 
The final nature of the complete problem might then be summed 

up as follows: 

1. Is there a general auditory factor? 

2. If not, is there any broad group factor which might be considered 
a practical approximation to a general factor? 

3. Are there also, or instead, four functionally distinct group fac- 
tors analogous to the physical concepts frequency, intensity, com- 
plexity, and duration? 

4. Within each of these factorial categories, can it be shown that 
various other forms of the typical function of that category are 
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sufficiently saturated with the structural content of that function 
to warrant consideration only as sub-types of that category? 

5. In addition to, or instead of, these four categories can it be dem- 
onstrated that complex auditory behavior involves functionally 
distinct auditory abilities corresponding to the postulated factors 
of rhythm, auditory analysis, auditory synthesis, and auditory 
memory ? 

6. To what extent do these four categories of pitch, loudness, qual- 
ity, and time underly the complex auditory behavior required in 
social situations? 

7. What can be shown factorially of the relation between auditory 
memory functions and visual memory functions? 

8. What part do age and intelligence play in auditory function? 


II. The Experiment 

All the tests were group auditory tests and were given to mem- 
bers of both sexes in Whiting High School, Indiana, during two weeks 
of testing in September 1941. The subjects were volunteers who were 
promised a report on the state of their hearing. The acoustic situa- 
tion was a school-room in a quiet part of the building. All the audi- 
tory tests were on records; the visual tests were given on a screen 
with a projector. About 25 subjects were tested at a time for sessions 
of 40 minutes per day. 


THE TESTS 
In setting up the problem the auditory field of this study was di- 
vided up into a number of domains on the basis of pre-existing evi- 
dence and a priori judgment. Each test therefore was chosen by this 
double criterion so as to have maximal representation in its particu- 
lar domain. 


I. The Pitch Domain: 
Tests 1-4 called for judgments as to which of two stimuli in each 
item was the higher in pitch. 


Test 1: Pitch Discrimination for Pure Tones 

This was the pitch test in the Seashore Tests of Musical Talent, 
Series A (10). The stimuli were constant in intensity, complexity, and 
duration but varied in frequency. The score was the number of cor- 
rect responses. 


Test 2: Pitch Discrimination for Complex Sounds 

The stimuli were complex sounds caused by setting in vibratory 
motion objects of differing resonance. The correct judgment for each 
item was taken to be the preference of the majority of subjects where 
a 2:1 judgment was obtained of one or other stimulus in each item. 
None of the physical factors were constant. 
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Test 3: Pitch Discrimination for Pure Tones of Short-Impulse 

In each item two pure tones differing supra-liminally in pitch 
were compared. The stimuli varied from a duration beneath the dura- 
tion threshold for pitch perception to one well above it. In each item 
intensity, complexity, and duration were held constant. 


Test 4: Pitch Discrimination for Vocal Sounds 

The stimuli in each item consisted of two monosyllabic vocal 
sounds vocalized on the same fundamental frequency. The correct re- 
sponse was determined on the basis of accepted standards of pitch 
differentials of vocal sounds (2). 


II. Loudness Domain: 
The instructions for these four tests (Tests 5-8) requested judg- 
ments as to which of the two stimuli in each item was the louder. 


Test 5: Loudness Discrimination for Pure Tones 

This was the loudness test in the Seashore Tests of Musical Tal- 
ent, Series A (10). The stimuli were constant in frequency, complex- 
ity, and duration but varied in intensity. The score was the number 
of correct responses. 


Test 6: Loudness Discrimination for Complex Sounds 
This was the same test as Test 2 with the same scoring criterion 


applied to loudness judgments. 


Test 7: Loudness Discrimination for Pure Tones of Short-Impulse 

In each item two pure tones differing supra-liminally in loudness 
were compared. The stimuli varied from a duration beneath the dura- 
tion threshold for loudness perception to one well above it. In each 
item frequency, complexity, and duration were constant. 


Test 8: The Pitch-Loudness Function 

In each item two pure tones of constant intensity, complexity, 
and duration but differing frequency were compared in loudness. The 
two frequencies for each item were so chosen that they would nor- 
mally be heard as differing in loudness on account of the differential 
sensitivity to frequency (3, 12). A correct response would be one fol- 
lowing the normal reaction. 


III, The Time Domain: 
This conventionally includes both filled and unfilled time. 


Test 9: Sense of Time for Sound-filled Intervals 

This was the Time test in the Seashore Tests of Musical Talent, 
Series A (10). In each item two tones of constant frequency, intens- 
ity, and complexity but differing duration are compared as to length. 
The score was the number of correct responses. 


Test 10: Sense of Time for Intervals of Silence 

This was the Time test in the earlier form of the Seashore Tests 
of Musical Talent (9). In each item the subject heard three clicks of 
constant frequency, complexity, and intensity but differing in tem- 
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poral arrangement. A correct judgment required deciding whether 
the silent interval between the first and second clicks was longer or 
shorter than the interval between the second and third clicks. 


IV. The Rhythm Domain: 
This includes motor rhythm and musical rhythm. 


Test 11: Motor Rhythm 

This was the Rhythm test in the Seashore Tests of Musical Tal- 
ent, Series A (10). Each item called for a “same-different” judgment 
of two rhythmic patterns in which the stimuli are tappings of con- 
stant frequency, intensity, and complexity. The score was the num- 
ber correct. 


Test 12: Musical Rhythm 

The subject decided whether short musical selections were being 
played in 2, 3, 4, or 6 time. The score was the number of correct 
judgments. 


V. The Quality Domain: 
This factor appeared to be represented also by several tests in 
other domains. 


Test 13: Quality Discrimination for Complex Tones 

This was the Timbre test in the Seashore Tests of Musical Tal- 
ent, Series A (10). Each item called for a “same-different” judg- 
ment of two complex tones of the same fundamental frequency but 
differing weights of upper partials. Total intensity and duration of 
the stimuli remained constant. 


VI. The Domain of Auditory Analysis: 
Tests in this domain involved the ability to hear under different 
masking conditions. 


Test 14: Sound Breakdown 
For each item the subject judged how many of five speakers had 
spoken a word simultaneously. The score was the number correct. 


Test 15: Pure Tone Masking 

Two tones of widely differing frequency were sounded together. 
The upper tone was the more intense at first; the lower tone gradu- 
ally became louder until it was audible together with the higher tone. 
The score obtained was the number correctly judged as having two 
tones. 


Test 16: Sensory Masking 

The subject was required to write down words heard against an 
increasingly loud buzzing background. The score obtained was the 
number of words heard correctly. 


Test 17: Intellective Masking 

The subject was required to write down isolated words heard 
against an increasingly loud background of a second continuous speak- 
er. The score obtained was the number of words heard correctly. 
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Test 18: Auditory Discrimination for Vowels and Consonants 

This was the Wepman Test of Auditory Discrimination used in 
the Speech clinic at Billings Hospital, University of Chicago. In each 
item the subject made a “same-different” judgment for two words 
differing in a vowel or consonant. The score obtained was the num- 
ber of correct responses. 


VII. The Domain of Auditory Synthesis: 

These tests tapped the ability of the organism to resist distor- 
tion of meaning due to disturbance of the temporal sequence of 
sounds. 


Test 19: Rapid Spelling 

The subject was required to write down familiar words which 
had been spelled out very rapidly. The score obtained was the num- 
ber of words correctly understood. 


Test 20: Singing 

The subject wrote down the words of a short vocal selection sung 
with piano accompaniment. The score obtained was the number of 
words correctly understood. 


Test 21: Haphazard Speech 

The subject wrote down the words of a short phrase spoken with 
unusual inflection and pitch changes. The score obtained was the 
number of words understood. 


Test 22: Illogical Grouping 

The subject was required to write down the words of a short 
phrase spoken with a grouping arrangement contrary to the sense of 
the passage. The score was the number of words understood. 


VIII. The Span Domain: 
This included both auditory and visual memory span. 


Test 23: Auditory Fusion Memory Span 

The auditory stimuli were nonsense-syllables of increasing length 
such that the words were all vocalizable. The letters were presented 
one per second. The score obtained was the number of words correct- 
ly written down. 


Test 28: Visual Fusion Memory Span 

The visual stimuli were nonsense-syllables of increasing length 
presented a letter at a time on a projector screen. Each letter was in 
view for about half a second. The words were all vocalizable. The 
score obtained was the number of words correctly written down. 


IX. The Auditory Memory Domain: 
This involved laboratory and social tests of memory. 


Test 24: Memory for Female Voices 
A number of female speakers read excerpts from homogeneous 
scientific material in random order of vocal re-appearance. For each 
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speaker the subject decided whether or not he had heard that speaker 
previously in the test. The score was the number correct. 


Test 25: Memory for Male Voices 
This was the same test as the previous one except that male 
voices were used. 


Test 26: Memory for Pitch Gestalt 

This was the Tonal Memory test in the Seashore Tests of Musical 
Talent, Series A (10). Each item required a comparison of two short 
melodic phrases which were identical except that one tone in one of 
the phrases was supra-liminally changed in pitch. The subject was 
required to name the ordinal number of the note changed. The score 
was the number correct. 


Test 27: Memory for Emphasis 

The subject heard a two-minute extract read with certain words 
markedly emphasized. He was required to identify these words on a 
written script at the conclusion of the reading. There were three 
such extracts. The score was the number of words correctly identified 
minus those incorrectly identified. 


X. The Visual Memory Domain: 
The memory tests chosen had previously been shown to be rela- 
tively independent of content. 


Test 29: Memory for Drawings 

The subject is shown a number of geometrical drawings on a 
screen and is later required to identify these drawings among simi- 
lar drawings. The score was the number correctly identified. 


Test 30: Memory for Boys’ Faces 
This was the same as the previous test with boys’ faces instead 
of drawings. 


Test 31: Memory for Limericks 

The subject was shown a number of limericks on the screen and 
was subsequently required to write in the last line of each limerick 
on the response sheet. The score was the number of last lines com- 
pletely correctly written in. 


XI. Miscellaneous: 
Test 32: Age 
The ages of the subjects ranged from 15 to 19 years. 


Test 33: Intelligence Quotient 
An I.Q. for each subject based on an Otis or Henmon-Nelson test 
was available from the school records. 


III. The Factor Analysis 


All tables of results are given at the end of the article. Each test 
was so scored that high score indicated high ability. The Pearson 
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product-moment correlations are shown in Table 1. It is seen that 
the auditory field is virtually a positive manifold. Inspection of the 
correlations led to the rejection of Test 15, Test 24, Test 30, and Test 
32 from the subsequent analysis. It is of interest to note that the cor- 
relation between Memory for Male Voices (Test 25) and Memory for 
Boys’ Faces (Test 30) is insignificant. 

The correlational table was factored by the grouping method re- 
cently developed in the Thurstone computing laboratory (14). This 
method is based on the same principles as the centroid method but the 
factors extracted are nearer the final rotated meaningful primary 
factors. It is possible to rotate from one set of results to the other 
by orthogonal transformations. Nine factors were extracted and ro- 
tated by oblique rotations with unextended vectors in accordance 
with the demands of simple structure. Eight unambiguous interpret- 
able planes emerged with the ninth factor a positive unidentifiable 
plane. The loadings on the centroid factors are given in Table 2; the 
rotated factor matrix is presented in Table 3. In Table 4 is shown 
the transformation matrix (A) leading from the centroid matrix (F-) 
to the final rotated matrix (V) by the function 


V=F,.A. 


The correlations between the primary vectors obtained by the equa- 
tion 

Ry = D(A'A)7 D’ 
are shown in Table 5, where D is a diagonal matrix such that the di- 
agonal entries in R must be unity. 


IV. Interpretation of Factors 
Each factor will be discussed in turn. For the most part load- 
ings below .30 will not be considered. 














Factor A 

Test 
4. Vocal Pitch Discrimination -70 
38. Short-Impulse Pitch Discrimination -__............... .67 
1. Pure Tone Pitch Discrimination .67 

13. Quality Discrimination .45 

26. Tonal Memory 42 
2. Complex Tone Pitch Discrimination -.............. .28 


In every one of these tests the two stimuli in each discrimina- 
tory judgment differ in the frequencies of the component parts of the 
tones. In Tests 3, 1, and 26 the difference is in the frequency of the 
fundamental and only frequency. In Test 4, 13, and 2 the difference 
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is either in the frequencies of the fundamental or the overtone struc- 
ture. It would appear, therefore, that pitch judgments are some func- 
tion of all audible frequencies in a stimulus. This functional unity is 
therefore termed a pitch-quality factor. In other words, the pitch of 
a sound is the weighted impression of both the fundamental and over- 
tone frequencies. Through training the pitch can be fixed as that of 
the fundamental; through training the effect of the overtone fre- 
quencies can be restricted to what are conventionally called timbre or 
quality judgments. Basically, however, the same functional system 
subserves both applications of the auditory frequency apparatus. The 
pitch and quality division is the result of a physically-derived view; 
psychologically, the division is probably an artifact. 

This factor will be known in this study as the PQ (pitch-quality) 
factor. 








Factor B 

Test 
7. Short-Impulse Loudness Discrimination -........ 48 
8. Pitch-Loudness Function AT 
6. Complex Sound Loudness Discrimination -....... 45 
5. Pure Tone Loudness Discrimination ................ 42 

25. Memory for Male Voices ’ 40 

33. Intelligence Quotient —..........2022222 ee eeeeeeeeeeeeee ol 


The interpretation that most readily suggests itself is a loudness 
factor. In Tests 7 and 5 it can be shown that the tones of each item 
differ in intensity; it is of significance that the same functional sys- 
tem that determines successful loudness discriminations in these two 
tests also turns out to be the tendency among the majority in a ran- 
dom population to decide between the two stimuli in Test 6 which 
cannot easily be measured in physical terms. Of further anatomical 
interest is the finding that success in the other loudness tests is bound 
up with the normal differential reaction to frequency in Test 8. The 
same system which enables the subject to discriminate the different 
intensities of a single frequency also enables him to discriminate the 
loudnesses of two different frequencies of the same intensity. 

It is seen that neither time nor complexity is particularly impor- 
tant for loudness judgments. It appears that the crux of the loudness 
function is the average strength of the psychological response to a 
given frequency. Memory for Male Voices would apparently depend 
upon the loudness level and loudness inflections characteristic of the 
individual speaker. The significance of the loading of the intelligence 
quotient is taken to be an indication of the possible perceptual level 
of the loudness function as opposed to the sensory level conventional- 
ly assumed. 
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This factor will be known as the L (loudness) factor in this 
study. 











Factor C 
Test 
10. Unfilled Time .50 
5. Pure Tone Loudness Discrimination ................ 48 
6. Complex Sound Loudness Discrimination ........ 38 
9. Filled Time 38 
14. Sound Breakdown 32 


This does not appear to be a time factor but is the closest ap- 
proximation to a time factor which is supported by the factorial evi- 
dence. The essential element common to all the test-projections is a 
mass quantity dependent on occurrence in time for its formation. 
The physical analogy of the integral symbol, f , is strongly suggested 
in the interpretation of this factor. The factor is therefore called 
the Auditory Integral for Perceptual Mass factor. 

The Auditory Integral for Perceptual Mass factor is defined 
operationally in the following way: Consider any auditory event occur- 
ring over a short period of time as being known by its average in- 
stantaneous loudness parameter and a time parameter. The primi- 
tive quantitative mass outlined by these two parameters becomes 
known in consciousness by an integrative process of the auditory 
mechanism, an integration of the mass quantity between the limits 
of the beginning and end of the auditory stimulation. If the para- 
meters of two auditory events are identical, then the magnitude of 
the integral is the same for the two events. If the average instan- 
taneous loudness parameters of two auditory events are identical but 
the time limits are narrower for one event, the integral for the short- 
er stimulus will be smaller in magnitude. If the time limits are the 
same for auditory events but the average instantaneous loudness 
parameter is smaller for one event, the integral will be smaller for 
that event. 

The mass quantity being integrated by this factor or ability ap- 
pears to consist both of the loudness response corresponding to the 
intensity of a sound and the positive after-image of that energy stim- 
ulation. In Unfilled Time (Test 10) three clicks form two intervals 
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of physical silence; psychologically, the positive after-image of a 
click lingers after cessation of the physical sound source; comparison 
of the integral for the after-image between the first and second clicks 
with that between the second and third clicks would yield a larger 
integral for the more widely separated clicks (see Figure 1). 

In Filled Time (Test 9) two sounds have the same instantane- 
ous loudness, but due to the fact that one of the sounds lasts longer, 
when the ear integrates the total perceptual mass between the two 
differing limits the integral will be larger for the sound with wider 
limits. In Pure Tone Loudness Discrimination (Test 5) two sounds 
have the same duration or the same limits for integration, but, since 
the average instantaneous loudness differs, the integral will be larger 
for the louder sound. In Complex Sound Loudness Discrimination 
(Test 6) there is presented a more variable picture of the process de- 
scribed above for Pure Tone Loudness Discrimination. The complex- 
ity of the sounds with the intensity rise-and-fall effects characteristic 
of the striking of gongs and similar media of vibration makes the in- 
tegration over approximately equal limits a more difficult matter. The 
saturation of this test with the Integral factor is correspondingly sig- 
nificant but smaller than that of the Pure Tone Loudness Test. 

The interpretation of this factor is materially facilitated by a 
consideration of the behavior of the four loudness tests in this domain. 
The loadings are: 


Test 
5. Pure Tone Loudness Discrimination ................ .48 
6. Complex Sound Loudness Discrimination ........ 38 
7. Short-Impulse Loudness Discrimination -......... 21 
8. Pitch-Loudness Function .08 





From the foregoing it would follow that the Integral factor is 
most effective in loudness discrimination with pure tones, less so with 
complex sounds, barely effective with short tones, and not at all opera- 
tive with the tones of the pitch-loudness function. It has already been 
shown that pure tone loudness discrimination involves this factor 
fairly considerably and that complex sound loudness discrimination 
would involve it to a lesser extent. In the case of short impulse loud- 
ness discrimination the two tones have identical time limits for inte- 
gration but differ in their average instantaneous loudness; however, 
the time limits are so short that the mass-integrative ability of the 
ear is afforded little opportunity to operate. The loading of this test 
on this factor is consequently small. In the case of the pitch-loudness 
function the time limits are identical and the intensity parameter is 
the same in that the physical energies of the two sounds are constant; 
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the integrative power of the ear is therefore not given any oppor- 
tunity at all to function. The loading of this test on this factor is, as 
would be expected, negligible. 

The nature of the psychological excitation represented pictorial- 
ly as the curves in Figure 1 above is at present indefinite. It seems 
possible that this type of response is similar to the corresponding re- 
sponse postulated in the visual field. Current evidence would place 
the onset of the auditory sensation at its maximum intensity between 
.12 sec. to .50 sec. after the onset of the physical stimulus ; termination 
of the auditory sensation occurs about .14 sec. after the physical stim- 
ulus is removed. These time values depend mainly on the intensity of 
the stimulus. It is to be supposed, therefore, that the integration of 
perceptual mass described above commences between .12 sec. and .50 
sec. after the physical stimulus is first sounded. The memory image 
of the stimulus, however, persists beyond the duration of actual sen- 
sation, so that the integration is probably in terms of both the sensa- 
tion and the memory image. The entire integral process is presum- 
ably of short duration, that is, less than a second, if integration is the 
basis for comparison of one stimulus with another. 

It is of interest to note that this factor appears to offer factorial 
evidence of a relation previously postulated both in the auditory and 
visual fields. Insofar as the integral is affected with equal ease by the 
time and the intensity parameters, it is in line with the Bunson-Ros- 
coe Law in vision and the Lifshitz Law in hearing, both of which pos- 
tulate that: 

It=K 
where J is the intensity, t the time of the stimulus, and K is a con- 
stant. 

Since these four loudness tests have about the same loadings on 
the L (loudness) factor and the correlation between this Auditory- 
Integral factor and the Loudness factor is insignificant, it may be 
stated that this Integral factor is in no way a form of the loudness 
function; the two are independent and the integrative function is 
operative on another level over and above the loudness level. 

This factor will be known as the AI (Auditory Integral) factor 
in this study. 











Factor D 
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an, weeps Seen 59 
22. Illogical Grouping Sn 
20. Singing 56 
17. Intellective Masking 30 
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This factor appears to underlie both the domains of auditory syn- 
thesis and analysis. Instead of one auditory ability enabling the or- 
ganism to resist distortion of words due to temporal disarrangement, 
and another ability for resistance to masking noises obscuring mean- 
ing, there is apparently a more central ability which serves both pur- 
poses. This factor will be known as the AR (auditory resistance) fac- 
tor. This functional system is probably widely operative in most au- 
ditory environments in social life. 











Factor E 
Test 
28. Visual Fusion Memory Span ...... ~ 53 
19. Rapid Spelling —................ 52 
17. Intellective Masking ........... ol 


The common characteristics of these tests is the rapidity with 
which the stimuli have to be received in order to be perceived. In each 
case stimuli are presented rapidly, and if the subject is able to inter- 
pret the rapid sensations as well as being able to receive them at that 
speed in the first case, he is able to perform the task. The importance 
of this factor is partly the fact that it denotes an ability which tran- 
scends sense modality and operates equally well in Test 28, a visual 
test, and Test 19, an auditory test. 

This factor will be known in this study as the SC or Speed of 


Closure factor. 











Factor F 
Test 
Zo. Beaty Memery Sean ................................... 49 
Dy.) Sn OS 38 
5. Pure Tone Loudness Discrimination -................. 4 
ig re eens P< | 
2. Complex Pitch Discrimination ..... .26 


This auditory factor apparently represents the actual mechanics 
by which the auditory memory span is formed; time, loudness, and 
pitch elements appear concerned here. This is not a memory factor 
primarily. This factor will be known as the ASF or Auditory Span 
Formation factor in this study. 














Factor G 
Test 
ee Ne ee eT 36 
2. Tonal Memory —_................. oO 
23. Auditory Fusion Memory Span .o2 
I a a esi cine dnsbiediceniibnaninenlanicoiann 29 
ea ee Tae 25 
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The interpretation offered here is that this factor is the true mem- 
ory element in the Memory Span factor. All the projected tests on 
this factor involve immediate recall of material within the span. The 
ability appears to hold for a variety of auditory stimuli and to extend 
to stimuli of the visual domain. This is probably a general span fac- 
tor independent of sense modality and has no relation to any other 
factor in the analysis. 

This factor will be known as the GS (General Span) factor. 














Factor H 
Test 
16. Sensory Masking 56 
31. Memory for Limericks 51 
33. Intelligence Quotient 49 
29. Memory for Drawings 4 


In Test 16 the material is presented auditorily; in Tests 31, 33, 
and 29 the stimuli are visual. In each of these tests the subject is pre- 
sented with an extensive array of possible stimuli and is required to 
give the greater part of his attention to a selected few of these stimuli. 
The comprehension of the crucial stimuli depends on a kind of mental 
alertness and ability to consider incidental stimuli only as means of 
obtaining the crucial stimuli. This ability enables the subject to re- 
produce the crucial stimuli at a later point, either immediate or de- 
layed, given certain partial clues from the incidental stimuli imme- 
diately preceding the crucial stimuli. 

This factor appears to be a closure effect transcending sense mo- 
dality, dependent on partial clues from the source of stimulation. The 
factor will be known as the IC or Incidental Closure factor. 

Factor J 
This appeared to be a positive uninterpretable plane. 

V. Evaluation of Hypotheses 

1. Problem: “Is there a general auditory factor, or any broad group 
factor which might approximate the general factor?” 

There is no support for either a first- or second-order general 
auditory factor. No factor has loadings on tests representative of the 
various primary factors. The indications are that auditory function 
occurs on different levels and that any single factor will be a poor 
approximation to a complete picture of hearing. 

2. Problem: “Are there four functionally distinct group factors ana- 
logous to the physical concepts frequency, intensity, complexity, 
and duration of sound waves?” 

None of these factors are verified as being simple sensory audi- 
tory factors. The pitch and quality tests are subsumed under a single 
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functional system, pitch-quality. The loudness factor is probably more 
of a perceptual process than has been suspected and is certainly more 
complex than previously supposed. The loudness function involves at 
least two functional unities, the average strength of the differential 
psychological response to sound in the L factor, and the integration 
of energy disturbance over given time limits in the AI factor. The 
pitch function, in contrast, is factorially quite simple. The time tests 
do not specifically define any time factor but play integral parts in 
the AJ factor. 


4. Problem: “What is the relation between different aspects of each 
of the foregoing four categories?” 


The four tests of pitch used are apparently legitimate forms of 
the same basic functional system and the same ability determines dis- 
criminatory judgments in all of them. Quality discrimination turns 
out to be another form of the same system as underlies pitch mani- 
festations. The four tests of loudness are equally good indications of 
the working of the loudness function; it seems, however, that in mak- 
ing loudness judgments in certain situations an integration of a more 
primitive perceptual mass is involved which is not involved in other 
loudness situations. The two tests of time behave in the same man- 
ner in the analysis, that is, ancillary to other functions. 


5. Problem: “Does complex auditory behavior involve rhythm, audi- 
tory analysis, auditory synthesis, and auditory memory as dis- 
tinct functional auditory abilities?” 


No rhythm factor is defined; the inference would seem to be that 
the rhythmic sense is kinaesthetic or central in nature. Both the pos- 
tulated abilities of auditory analysis and auditory synthesis break 
down to a single entity, the AR factor. Auditory memory is impor- 
tant, yielding several memory factors even with comparatively few 
memory tests. 


6. Problem: “To what extent do the simpler tests of pitch, quality, 
loudness, and time underlie more complex social auditory behav- 
ior?” 

These tests are involved principally only in the PQ, L, and Al 
functions. These latter functions are not related to the other auditory 
functions which appear to be more directly concerned with social au- 
dition. This finding is cause for concern regarding current practice 
of assuming that complex auditory behavior is explainable in terms 
of performance on the simpler functions. 
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7. Problem: “What is shown here regarding the relation of visual 
and auditory memory functions?” 

Three of the four tests involving memory tests were common to 
both the visual and auditory field. Both kinds of memory function 
tend to be specific, but this specificity is largely independent of sense 
modality. 

8. Problem: “What part do age and intelligence play in auditory 
function?” 

Biological growth in this age range had no effect on goodness of 
performance of auditory mechanisms. The effect of intelligence was 
less marked in the complex auditory functions than might have been 
expected ; the relation of intelligence to the loudness factor was rather 
surprising. 

VI. Summary of the Investigation 

This investigation was concerned with the factorial description 
of correlated individual differences in the auditory field. Several hy- 
potheses as to the nature of auditory function among normally-hear- 
ing subjects were being empirically investigated. A population of 200 
high-school individuals were given 27 group auditory tests and 4 
group visual memory tests; the age and intelligence quotient of each 
subject was also considered. The correlations of 29 of these tests were 
obtained and factored to nine factors. The configuration was rotated 
to a meaningful oblique simple structure. Interpretation of eight fac- 
tors is offered. 

A large number of conclusions might be drawn from this initial 
factorial study of the auditory field. Some of the main conclusions 
drawn are mentioned below: 


1, There is no general auditory factor; no group factor appears to 
offer a practical approximation to a general factor. 

2. The pitch and quality categories break down to a single basic pro- 
cess; the loudness tests appear more complex than the pitch-qual- 
ity tests and require at least two distinct processes for successful 
performance; the time tests do not define any time factor but play 
an integral part in several of the other auditory factors. 

3. Rhythm does not appear to be an auditory factor primarily; ade- 
quate auditory response-patterns in complex auditory situations 
do not appear to require rhythm to any appreciable extent. 

4. The phenomena of auditory analysis and auditory synthesis are 
subsumed under a single functional system, a resistance to dis- 
tortion factor. 

5. Both auditory and visual memory functions appear highly spe- 
cific but overlap in their specificity to produce several central fac- 
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tors independent of sense modality, notably a general span factor. 
6. For high-school subjects neither age nor intelligence play any im- 
portant part in most of the auditory functions. 
7. The conventional auditory acuity tests have little predictive value 
for auditory behavior in more complex social situations for nor- 
mally-hearing subjects. 
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yard R. Tucker in the statistical analysis. The investigation was pos- 
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cost of tabulating machine services in the factorial work. Acknowledg- 
ment is also made to the Psychometric Laboratory and the Social Sci- 
ence Research Committee of the University of Chicago for the use of 
equipment and for computing. 

This report is an abbreviated account of selected portions of a 
Ph.D. thesis in the Department of Psychology at the University of 
Chicago. There appears to be a rather general interest in the results 
of this study both on the part of psychologists and investigators in 
other fields; a complete account of the investigation will therefore 
appear in monograph form. 
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TABLE 1 
Correlation Matrix (continued) * 











18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 
18 
19 098 
20 188 225 
21 040 187 348 
22 176 163 400 462 
23 109 156 193 057 199 
24 069 014 110 023 021 -006 
25 068 149 199 112 095 168 367 
26 107 258 #282 197 364 178 065 237 
27 O74 152 169 O61 2381 216 014 054 = 168 
28 O58 421 121 -085 080 358 -039 141 172 1388 
29 040 180 092 204 202 042 019 004 187 162 198 
30 070 059 O54 171 101 027 -101 092 096 O77 044 167 
3 067 313 086 009 174 180 005 O72 152 175 167 326 8 085 
82 023 -088 027 056 153 -008 -003 -004 261 056 -069 -132 016 -196 
33 093 344 009 064 194 129 -005 095 174 100 170 298 089 394 -236 








* The decimal points preceding all correlation coefficients have been omitted. 
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Unrotated Factorial Matrix 
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TABLE 3 
Rotated Factorial Matrix 








Centroid Factor A B C D E F G H J 


Psychological Factor PQ L AI AR SC ASF GS _ IC J 
1 69 09 00 =6-08 02 01 17 -02 -03 
z 28 05 04 08 -07 26 -07 10 24 
3 67 04 -03 05 03 16 03 03 04 
4 70 07 + -07 08 04 04 -09 03 = -10 
5 15 42 48 -03 -03 384 -02 00 01 
6 -07 45 38-01 02 -07 = -02 07 03 
7 -01 48 21 05 -03 18 -07 11 40 
8 -01 47 09 -12 02 03 =-08 05 26 
9 13 01 388 -07 -01 88 -04 -08 29 

10 24 23 50 00 86-08 27 -03 02 07 
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TABLE 4 
Direction Cosines of the Reference Vectors 
A B C D E F G H J 
I 68 18 20 08 14 25 15 07 06 
II -85 -09 17 80 01 -19 27 83 21 
III -31 17 62 -22 -08 25 -10 02 31 
IV -20 09 +-16 -26 15 -26 -0O1 67 -10 
V -83 -29 06 = -37 26 66 85 11 19 
VI -31 14 -11 21 8 -18 -16 -54 -07 
Vil -02 -29 18 10 04 30 -86 23 15 
VIII -13 41 -68 09 «=-41 31 06 12 21 
IX 26 02 #-12 =+-18 -04 -87 02 25 86 
TABLE 5 
Correlations Between the Primary Vectors 
A B C D E F G H J 
A 1.00 PQ 
B 20 1.00 L 
C 08 -16 1.00 Al 
D 18 18 07 1.00 AR 
E 84 28 # -20 08 1.00 SC 
F 20 06 # -18 32 18 1.00 ASF 
G 03 -07 16 = -01 03 01 1.00 GS 
H 19 24 -07 11 41 13 —02 1.00 IC 
J -08 -26 —04 02 03 02 00 8-33 100 J 
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TEST SCORES EXAMINED WITH THE LEXIS RATIO 


HAROLD A. EDGERTON AND KENNETH F. THOMSON 
THE OHIO STATE UNIVERSITY 


The Lexis Ratio is discussed in its application to distributions 
of test scores where the items of the test can be assumed to be of 
equal difficulty. The ratio indicates the extent to which inter-individ- 
ual variation operates as a source of the variance. The concept is 
related to the Lexis, Bernoulli, and Poisson distributions and illus- 
trated by urn schemata. The Ratio is applied to the scores of 560 
university freshmen on the Robinson Reading Test. The relation of 
the Lexis Ratio to the Kuder-Richardson estimation of reliability is 
also discussed and the latter authors’ case IV is rewritten explicitly 
in terms of the Ratio. 


The Lexis ratio is a statistic used to show whether a distribu- 
tion of observations has hypernormal, normal, or subnormal disper- 
sion. The hypernorma!l or Lexis distribution is of particular interest 
in connection with test scores, since with this type of distribution 
one may infer that differences among the individuals tested are pres- 
ent as a source of variance. A hypernormal (Lexis) dispersion is ob- 
tained when the probability of occurrence of an event is constant from 
trial to trial within a set, but varies from set to set. Put into terms 
of test scores, the term trial refers to a test item, the term set to the 
individual taking the test. 

A normal] (Bernoulli) dispersion may be said to reflect no real 
individual differences, since normal dispersion is to be expected when 
the probability of occurrence of an event not only is constant from 
trial to trial within a set, but also is constant from set to set. In 
terms of testing, this would correspond to the responses of a popula- 
tion of identical individuals on a test all items of which are of equal 
difficulty. 

A subnormal (Poisson) dispersion does not enter the picture of 
testing, since it is obtained when the probability of the occurrence of 
an event varies from trial to trial, but the several probabilities of 
every one set of trials are identical with those of the corresponding 
trials of every other set. 

In order to apply the Lexis ratio technique, the test score for the 
individual must be expressed as the per cent or proportion of “suc- 
cessful” trials. The items are, by assumption, of equal difficulty. 

Urn schemata can be used to illustrate the Lexis distribution. 
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Let us suppose that five urns have been filled with black and white 
balls, and so maintained that the probabilities of drawing a white ball 
from the first urn will be 1/10, from the second 2/5, from the third 
1/2, from the fourth 4/5, and from the fifth 7/10. From each urn a 
set of 10 drawings of one ball each will be made. 

The score for a set is the ratio of white balls drawn to the total 
of balls drawn, Within each set (urn), the probabilities of a white 
ball are constant from trial to trial. But the probabilities of the draw- 
ing of a white ball vary from set to set. The scores for the five sets 
will differ,-and the dispersion will be hypernormal. 

Similarly, in a test where the items are of equal difficulty and 
where the individuals taking the test differ in ability, one may expect 
a Lexis or hypernormal dispersion of test scores. 

Thus the Lexis ratio would seem to afford a convenient means 
for the examination of percentage test scores of various samples. A 
limitation of convenience in the use of this technique is that the test 
must permit a count of “items attempted.” Where items are so ar- 
ranged or instructions so worded that the testee may skip an item or 
items without penalty, the increased clerical work necessary to deter- 
mine “items attempted” might weigh against the use of the technique 
on economic grounds. 

The Lexis ratio, 


L=<a/oz, (1) 


compares the obtained dispersion, «, of percentage scores on a test 
with the theoretically expected dispersion, o;, calculated from the 
mean percentage success and the mean number of items attempted. 

When EL > 1, we have a Lexis distribution and may infer that a 
portion of the variance is due to differences among the individuals. 
When L —1, we have a Bernoulli distribution and may infer that the 
observations differ from their mean value only because of chance fac- 
tors. 

The formula for the Lexis ratio may also be written 


’ 


Cc 
L= ae | (2) 

OB 
where o’ is the observed standard deviation of a series of scores, each 
score expressed as a proportion or per cent. This value may be cal- 
culated by any of the usual procedures. The value of o's is given by 

the formula 
pq 

o's — ar he | (3) 


s 
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where p = mean value of scores, (each one expressed as proportion or 
per cent), 


q= (1 — p) for scores expressed as proportions, or (100 — p) 
if the scores are expressed as per cents, 

s=number of items attempted by each individual, and is the 
denominator used in obtaining proportion or per cent 
scores. In case all individuals did not attempt the same 
number of items, s may be taken here as the mean number 
of items attempted. 


As a demonstration of the application of the method to actual 
data, the technique was used on the scores in “percentage comprehen- 
sion” on the Robinson Reading Test.* ; 


The Robinson Reading Test consists of a standard reading deal- 
ing with a certain subject and a separate set of questions covering 
factual material presented in the reading. At the end of ten minutes 
spent in reading the material, the testee is asked to indicate the num- 
ber of lines of the material he has read in the period. This mark in- 
dicates his average reading speed for the given period. The reading 
material is then removed and the set of questions is given with the 
instructions that he is to answer or attempt to answer all the ques- 
tions up to and including the end point reached during the reading 
period. A scale is included on the question sheet to indicate the lines 
of reading covered by each question. The comprehension score is cal- 
culated by dividing the number of items answered correctly by the 
number of items attempted, and hence is amenable to investigation 
by the Lexis ratio. 

The sample used for this demonstration is made up from 560 
Robinson Reading Tests given to College of Education freshmen at 
The Ohio State University in the Autumn quarter of 1941.+ The first 
question to be answered here would be: Do the comprehension scores 
observed in this sample reflect individual differences? To answer the 
question, the entire 560 cases were utilized. From the data of the 


sample: 
N = 560 
p = 65.71 per cent (mean per cent correct answers) 


q= 100 — p= 34.29 


* Robinson, F. P. and Hall, P., Studies of higher-level reading abilities, J. 


Educ. Psychol., 1941, 32, 241-252. 
t+ These data were made available through the courtesy of L. L. Love, Junior 


Dean of the College of Education. 
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$= 24.78 (mean number of items attempted) 








o = 13.691 
see (65.71) (34.29) ~ 
op 24.78 = 9.536 
__ 13.691 ‘oie 
—— 


May we now conclude that this distribution of errors has hyper- 
normal dispersion and that individual differences rather than item 
differences on the test are reflected? The probable error of the Lexis 
ratio is given by the formula: 

4% 4769 L 


Ma cee, 


VN 
For the Lexis ratio above, 
_ (4769) (1.436) _ 


PE. = ow 
V 560 


The critical ratio sought is one which will answer the question: Is 
it within reason to assume that the observed Lexis ratio could have 
been drawn from a universe in which the true value of the Lexis ratio 
is 1.00? Hence we may take the function 


L-1  .486 
= = = 15.1. 
PE,  .0289 


On the basis of such a critical ratio, it may be concluded that the 
Lexis ratio of 1.436 differs significantly from 1.00, and so it is in- 
ferred that the observed differences in reading comprehension may in 
part be ascribed to differences among the individuals. 

It may be noted that in the Robinson Reading Test, the number 
of items attempted was a function of reading speed. The question 
then arose as to whether or not the comprehension score reflected 
individual differences when reading speed was held relatively con- 
stant. In order to investigate this aspect, eight sub-samples were se- 
lected from the total sample. 

Groups B, D, and G are the more heterogeneous in terms of varia- 
tion in reading speed. The evidence does suggest that the test does 
not reflect individual differences so well for slower readers as for aver- 
age and rapid readers. Such evidence is only suggestive. The hy- 
pothesis might well be investigated in a more appropriate situation. 
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The results in detail for these eight sub-groups are shown in 


Table 1. In all cases L is greater than unity. 
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As a further check upon the reality of differences of reading com- 
prehension between fast and slow readers, 50 cases in the faster- 
reading range were re-scored upon a basis of the questions attempted 
by one of the slower reading groups. The faster readers, all having 
attempted 29 questions (mean reading speed of about 235 W.P.M.), 
were compared over the same range of questions as the slower group, 
having attempted 22 questions (mean reading speed about 173 W.P. 
M.). 

Presumably, if there are no real differences in reading compre- 
hension between the fast and the slow reader, a comparison over the 
same range of questions would reveal that the narrowing of the range 
of questions over which the faster reading individuals could differ 
would correspondingly reduce our index of individual differences. The 
reverse of this was obtained. The Lexis ratio of the 50 case samples 
of faster readers was 1.37 compared to 1.18 for the slow readers. Re- 
ducing the range of response of the fast readers, instead of reducing 
the opportunity for appearance of individual differences, seemed to 
have actually reduced the opportunity for chance differences, while 
leaving the factor of individual differences in full operation. 

The notion that variance of test scores is due to differences among 
the individuals is apparently another way of referring to the reliabil- 
ity of the test. Therefore we might expect the Lexis ratio to occur in 
some of the formulae for the estimation of test reliability. This occur- 
rence seems to take place in Case IV of the Kuder-Richardson* for- 


mula for estimating test reliability. 
Case IV of the Kuder-Richardson formula is: 
n oe pq 


. ’ 
ares wy 


(5) 





if ee 


where n = number of items in the test, 


= mean proportion of items right, 
o; — standard deviation of test scores (items right). 


Comparing this notation with that used in the previous discus- 
sion, it may be noted that: 


n=S8;3 


” =» (proportion). 


* Kuder, G. F., and Richardson, M. W. The theory of the estimation of test 
reliability, Psychometrika, 1937, 2, 151-160. 
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Since m may be considered a constant, the standard deviation of scores 
expressed as proportions of items attempted is 


ot 


For the Kuder-Richardson o*?; , we may write s*(o’)? and for pq , the 
quantity s*(o';)? may be substituted. Then the Kuder-Richardson 
formula may be rewritten 


S 8°(a)? — s?(o's)? 
a=] 8? (0')? 


(6) 





rT i 
This reduces to 


hia ili ae (7) 
om aaa Tie 


1 
As the Lexis ratio, L, increases, it will be seen that the value of RP 


will decrease toward zero as a limit and that the reliability coefficient 
will approach unity. In other words, as the distribution departs more 
and more strongly from the theoretically expected (chance) distribu- 
tion, indicating a greater variance due to individual differences, the 
estimate of the reliability of the test is correspondingly increased. 
Should the ratio, L, approximate unity, the value of = will approxi- 
mate unity, so that the value of the term within the parentheses will 
approach zero, as will the reliability coefficient. This would indicate 
that the distributions obtained were what might be expected upon the 
basis of chance alone. 

If, however, the ratio, L , decreases to less than unity, as in a 


1 
Poisson distribution, it will be seen that the value of 7 will increase 


so that the value of the term within the parentheses will be negative, 
as will the reliability coefficient. In connection with the possibilities 
of occurrence of a negative reliability coefficient, the comments of 
Kuder and Richardson are pertinent. 


For 7; to be positive, o?, must exceed npq. Now npq is 
the variance of » equally difficult items when they are un- 
correlated, by the familiar binomial theorem. Hence 7;; is 
positive for any average inter-item correlation that is posi- 
tive. But negative reliability is inadmissible; hence only to 
the extent to which test items are positively intercorrelated 
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will a test have reliability. It is implicit in all formulations 
of the reliability problem that reliability is the characteristic 
of a test possessed by virtue of the positive intercorrelations 
of the items composing it. 


For the eight subsamples, the reliabilities computed by formula 
(7) are shown in Table 1, along with probable errors. However, a 
better basis of judging whether or not such reliabilities could rea- 
sonably be obtained from a universe where the true value is zero can 
be gotten from either Fisher’s z transformation or the probable error 
of a coefficient of correlation of zero. In order to refrain from unduly 
complicating the demonstration, the latter function has been used. 

Table 2 shows the corresponding values for r;; for selected values 
of L. This table was constituted on the assumption that s is large, 
so that s/(s—1) approaches unity. 





TABLE 2 
Values of r,, for selected values of L 
L Tre 
1.00 .00 
1.2 ol 
1.4 49 
1.6 61 
1.8 69 
2.0 15 
3.0 89 
4.0 94 
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DERIVATION AND APPLICATION OF A UNIT SCORING 
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Scoring keys, based upon unit weights, were made up for four- 
teen occupations of the Strong Vocational Interest Blank for Women. 
The study here presented of scores obtained in using these keys, in 
comparison with scores obtained from Dr. Strong’s keys, indicates, 
for 551 women at the University of Rochester, that the new, unit- 
weighted keys are valid for all practical purposes and make possible 
a great saving in scoring time. 


The Strong Vocational Interest Blank is a clinical instrument 
used in universities, personnel departments, and guidance offices. 
However, because of the considerable time and effort involved in scor- 
ing the test, even when machine methods are available, its use is cost- 
ly and is restricted to a greater degree than is desirable. In view of 
these factors, a simplification of the scoring technique was proposed, 
involving the construction of new keys with unit weights for the item 
responses. This procedure was carried out in an extensive study of 
the Strong Vocational Interest Blank for Men with results that quite 
clearly justified the use of the unit keys; the outcome of this study 
was reported before the American Psychological Association in 1940 
and appeared in the Journal of Consulting Psychology (Vol. V, no. 6, 
1941). The present report deals with the application of the method 
to the blank for women. 

The test is so constructed that a score in any occupation indicates 
the degree to which the subject’s interests agree with those of success- 
ful individuals in that field. In effect, scoring the blank for a particu- 
lar occupation is merely comparing the subject’s pattern of marking, 
or his pattern of reactions to the items, with the typical pattern of 
the standardization group of individuals. Therefore, for each occupa- 
tional rating, the individual’s pattern of marks must be checked 
against a set of weights specific to each occupation. Since the wom- 
en’s blank contains 410 items, each with three possible responses, 
“like,” “indifferent,” and “dislike,” the magnitude of the scoring task 
is apparent. 
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It is when the blank is scored by hand or on an electrical test scor- 
ing machine that the unit weights here proposed are particularly ap- 
plicable. Although the men’s blank is now available in machine- 
scored form, the women’s blank has not yet been so adapted. Per- 
haps the basic reason why it has not been so modified is a mechanical 
one—that the answer sheet for use in the test scoring machine accom- 
modates only 400 items. Therefore, the scoring of the women’s blanks 
in this study was done on Hollerith equipment, using like, indifferent, 
and dislike cards for each item of the test, with a view to applying 
the results, if favorable, to the machine-scored method. 

Using the test scoring machine with Strong’s original range of 
weights from +4 to —4 necessitates two insertions of each paper into 
the machine for one side of the sheet, once when the machine is set 
so as to record values of plus or minus one and once when set to record 
plus or minus three. Thus, by punching the scoring stencils to the ap- 
propriate combinations of these values, any weights from +4 to —4 
can be obtained simply by the addition of the two scores from the two 
separate runs. Since one side of an answer sheet can accommodate 
only 200 of such items, papers have to be run through the machine a 
total of four times, twice for each side of the sheet, and four values 
would have to be added in order to secure the final score for the oc- 
cupation. 

The simplified method of scoring of this study proposes reduc- 
ing all weights of +2, +3, and +4 to +1, weights of —2, —3, and —4 
to —1, and leaving weights of +1, 0, and —1 unchanged. Throughout 
this report, whenever scores are referred to as “original,” they have 
been obtained using Strong’s weights ranging from +4 to —4, while 
“unit” scores have been obtained using the new simplified weights 
ranging from +1 to —1. 

Machine scoring stencils can be constructed with all weights 
considered as unit weights. The use of these stencils would save half 
the machine time since only one run is necessary for each side of the 
answer sheet and one third of the time in addition since only one addi- 
tion is required rather than three. 

The major problem in this study was to determine the effect of 
unit weights on the scores, and secondarily, it was necessary to elimi- 
nate ten items so that the blank could be adapted for the test scoring 
machine. The investigation concerned itself with fourteen scales for 
the women’s blanks, so that there were a possible 42 effective weights 
for each item. The number of effective weights was determined for 
each item and ten items having the fewest weights were selected to 
be eliminated on the answer sheet. The items eliminated were 125, 
141, 151, 155, 218, 228, 243, 245, 257, and 367, and the number of 





ve SY 


. oll 








BERTHA P. HARPER AND JACK W. DUNLAP 291 


effective weights for these items were, respectively, 4, 4, 3, 3, 4, 5, 3, 
8, 5, and 2. 

Scoring the Strong Vocational Interest Blank for Women on the 
Hollerith equipment involved first “pulling” a set of 410 cards from 
a file of 1230 cards, according to the way the subject marked the test 
(for example, a “like” card for item 1, an “indifferent” card for item 
2, and so on), and then running these cards through the tabulator to 
obtain the “original” totals for the various occupations. Weights on 
the new unit method for the various occupations for the women’s 
blank were punched into the unused remainder of the cards. Thus, 
once a set of cards was “pulled” for an individual, both sets of totals, 
for the new and old sets of weights, were obtained simultaneously for 
the occupations studied. The ten items that were being studied for 
possible elimination were always kept separately so that it was pos- 
sible to secure four scores for each occupation—the original score on 
400 items, the original score on 410 items, and similarly unit scores 
for 400 and 410 items. 

All of these scores were obtained for fourteen occupations, in- 
cluding artist, author, librarian, secretary, lawyer, physician, nurse, 
social worker, Y.W.C.A. secretary, teacher in general, social science 
teacher, mathematics-science teacher, English teacher, and mascu- 
linity-femininity. 

The subjects were 551 women students at the University of Ro- 
chester, comprising the four classes in college at the time the study 
was conducted. For the purpose of the study this group was divided 
in a random manner into two sections, one of 328 individuals which 
was called the “experimental group,” and one of 223 individuals which 
was called the “control group.” 

The underlying methodology in the experimental design of the 
problem is that of correlation and regression. The validity of the unit 
scores was first tested by obtaining the correlation coefficients be- 
tween scores obtained by the old method and the new. However, the 
magnitude of the correlation coefficient in itself is meaningless except 
on purely theoretical grounds. Considerations of practical utility de- 
mand comparisons of the results of the two methods, that is, of the 
final letter grade ratings upon the basis of which advice is given. 
Therefore, regression equations were constructed and applied to a 
new set of data (which has been called the control group), thus pre- 
dicting original scores from a knowledge of the unit scores of this 
new group. Then, if close similarity can be demonstrated between 
the predicted values and the actual values, it seems reasonable to 
place a fair amount of confidence in the accuracy of the new method. 

Before attacking the main problem in this manner it was neces- 
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sary to determine whether or not it is feasible to eliminate the ten 
items mentioned. Therefore, correlations were determined between 
the original scores based upon 400 items and those based upon 410 
items for the entire group of 551 individuals. Eight of these were 
.999, three were .998, and the remaining three were .997, .989, and 
.985 respectively. These high correlations, when considered together 
with the paucity of the weights for these items, seemed justification 
for their elimination. 

After this study had been completed, correspondence with Dr. 
Strong revealed that he had planned to eliminate ten items. Seven of 
the ten were common to both sets of items eliminated, and in the case 
of the other three, it was a matter of choice, since there was little or 
no difference in the number of effective weights. In preparing the 
final unit keys, the following ten items were eliminated in order to 
agree with Dr. Strong’s revision: 131, 141, 218, 228, 236, 2438, 245, 
257, 348, and 367. This slight shift will in no way affect the results 
of the investigation, and the regression equations and tables may be 
used with confidence. 

The next step was then obtaining the correlations between the 
original and unit scores in what has been called the “experimental 
group.” In order to subject the data to the most rigorous set of cross- 
correlations for the purposes of constructing a machine-scored edi- 
tion, in all cases the original scores based on 410 items were used ver- 


TABLE 1 


Correlations between Original and Unit Scores for the Experimental Group, 
together with Regression Coefficients and Constants 











N = 828 
Regression 
Occupation Correlation Coefficient Constant 

Artist .985 1.76 16.74 
Author -986 1.64 51.90 
Librarian 977 1.11 —7.95 
Secretary -983 1.40 —2.46 
Lawyer .976 1.42 1.70 
Y.W.C.A. Secretary 977 1.52 3.64 
Social Worker 953 1.34 —1.24 
Physician 951 1.32 4.97 
Nurse 975 1.29 —9,.91 
English Teacher .961 1.33 3.57 
Teacher in General 951 1.33 —2.85 
Math-Science Teacher .966 1.38 0.60 
Social Science Teacher .959 1.33 —7.19 


Masculinity-femininity .980 1.39 —5.72 
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sus the unit scores based on 400 items. 

The second column of Table 1 contains the correlation coeffici- 
ents, which range from .986 for the author scale to .951 for physician. 

Using these correlation coefficients with the corresponding means 
and standard deviations, regression equations were constructed for 
the various occupational scales for the prediction of original scores 
from a knowledge of unit scores. In the third and fourth columns of 
Table 1 appear the regression coefficients and constants that were 
derived. 

The next step was the application of the regression equations to 
the unit scores of the control group of 223 individuals to predict in 
each case what the original score would be for that occupation. An 
analysis was made of the accuracy of these predictions in three ways. 
First, correlations were computed between the predicted values and 
the actual scores. From the second column of Table 2 it is seen that 
the best prediction in terms of the magnitude of the correlation co- 
efficient was for the artist scale, with a value of .973, while the low- 
est coefficient was for teacher in general with a value of .919. These 


TABLE 2 


Correlations Between Predicted Original Scores and Actual Scores for the Control 
Group, and the Analysis of Shifts in Letter Grades When Original Scores 
Are Predicted, together with the Number of B Ratings 
That Occurred in the Scoring 














N = 223 
No. No. No. 
Changesof Changesof Changes Number of 
Occupation Correlation One-Half Letter One Letter Orig. B+-to B Scores 
’ Grade Grade Unit Score B (Unit Sc.) 

Artist .973 35 0 6 29 
Author 971 37 0 2 27 
Librarian .945 40 2 3 24 
Secretary -960 45 0 ic 44 
Lawyer .946 53 1 10 28 
Y.W.C.A. Secretary .930 56 0 7 17 
Social Worker .936 64 1 7 18 
Physician .932 49 2 3 15 
Nurse .947 67 2 8 37 
English Teacher .937 45 6 2 19 
Teacher in General .919 69 8 v 23 
Math.-Science Teacher .925 65 5 4 17 
Social Science Teacher .924 57 1 4 16 
Masculinity-femininity 927 21 0 1 8 

Total 703 28 Tt 822 

Per Cent 22.5 0.9 2.8 10.3 
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coefficients approach substantially the magnitude of the values ob- 
tained for the experimental group. 

Next, an analysis was made of the shifts in letter grades that oc- 
curred in the predictions of original scores of the control group. Out 
of the 3122 scores that were studied in the control group (fourteen 
occupations times 223 individuals), 703 or 22.5 per cent were altered 
to the extent of one-half letter grade, as shown in the third column 
of Table 2. Changes of one letter grade occurred in only 28 or 0.9 
per cent of the cases. 

The majority of these shifts are not, however, of practical sig- 
nificance. It matters little whether one method rates an individual 
C and the other C+ or one B and the other B— . The important shifts 
are those occurring in the range where the counselor decides whether 
or not the score is sufficiently high that he should give favorable advice 
upon it. The general practice in guidance work usually is to give posi- 
tive consideration to those occupations rated A or B+ and only doubt- 
ful consideration to lower scores. For example, Dr. John Darley, a 
noted authority in the clinical field, considers only scores of A and B+ 
in primary interest patterns; lower scores are grouped into secondary 
and tertiary patterns. 

The crucial changes in scores are, therefore, those between B and 
B+. Of particular importance are those cases where the individual 
has an original score of B+, but, according to the unit scoring, would 
be rated only B. If no favorable advice is given on a B rating, the 
individual’s attention is not called to the field. If, however, the true 
score is B and the unit score is B+, then slightly more emphasis is 
given to the occupation than is its due. This is not so serious as the 
failure of the counselor to mention the field. The critical cases are, 
thus, those of under-prediction, where the new method ranks an in- 
dividual only at B when he should have been rated B+. The fifth col- 
umn of Table 2 indicates that only 71 times in 3122, or two per cent 
of the time would the counselor have failed to mention an occupa- 
tional area in using the unit method. If, however, it seems essential 
that as low a percentage of error as approximately one in fifty be 
eliminated, the alternative remains of rescoring with the original 
scales the papers rated B by the new method. As shown in the last 
column of Table 2, about ten per cent of the papers would, in that 
case, have to be rescored. Very frequently the counselor will utilize 
the individual’s pattern of scores; the pattern of scores obtained using 
the unit keys is the same as that obtained with the original. 

As a further verification of the method, an independent check 
study was carried out for the class of women entering in the fall of 
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1940. Both original and unit scores were obtained for 132 individuals, 
and the correlations between them were found to range from .949 to 
.991. These coefficients, as well as the means and standard deviations, 
were found to be of about the same magnitude as those obtained in 
the major study, as is shown in Table 3. Shifts of one-half letter 
grade occurred in 20.9 per cent of the cases (387 out of 1848 cases), 
as compared with 22.5 per cent in the original study, and of one let- 
ter grade in 1.2 per cent of the cases (22 out of 1848 cases), as com- 
pared with 0.9 per cent previously. Original scores of B+ would have 
been changed to B by the unit method in only 1.8 per cent of the cases; 
in other words, in this new group, advice would have been altered in 
one case in 56, as compared with one in 43 before. The same propor- 
tion of B scores occurred as did in the major group, 10.3 per cent. This 
check study seemed in every respect to verify the results obtained in 
the major study. 

The results of the study of the use of unit-weighted scoring keys 
for the Strong Vocational Interest Blank for Women are in close 
agreement with those shown earlier for the blank for men. In view 
of the high correlations between original and unit scores, the consid- 
erable accuracy of prediction of original scores from unit scores of 
independent groups, and the few instances where the use of unit 
scores would have altered advice given to subjects, the unit-weighted 
method is recommended, as a means of reducing scoring time and 
costs and correspondingly extending the use of the test in general 
guidance work. 


TABLE 3 


Comparison of Results from Check Study with 
Those from Original Study 








Original Study Check Study 





Range of Correlations, 


Original vs. Unit .951 — .986 -949 — .991 
Scores 
Per Cent of Changes of 
One-Half Letter Grade 22.5 20.9 
Per Cent of Changes of 
One Letter Grade 0.9 1.2 
Per Cent of Changes 
Original Score B+ to 2.0 1.8 
Unit Score B 
Per Cent of B Scores 10.3 10.3 


(Unit scoring) 


























W. G. Emmett. An Inquiry Into the Prediction of Secondary-School Success. Uni- 
versity of London Press, 1942. Pp. 58. 


A REVIEW 


There have been many efforts to determine the value of tests in predicting 
academic or vocational success. The results of most of these studies are dubious 
because of the operation of selection. The correlations of the initial tests and 
the criteria of success and the regression coefficients used in prediction are 
smaller than they would be if selection had not operated. The reason for this 
state of affairs is that criterion measures are not usually obtainable for all mem- 
bers of the population taking the initial tests. The research reported by Emmett 
is unique in that techniques are applied which yield estimates of the regression 
coefficients, their standard errors, and the correlations which would be obtained 
had selection not operated. Use was made of Aitken’s matrix formulation of Karl 
Pearson’s selection equations. The procedure is illustrated for three independent 
variables—intelligence quotient, English score, and arithmetic score. Appendix 
III of the monograph shows how Aitken’s method of pivotal condensation can be 
used when extending the procedure to more than three independent variables. 
This scholarly little monograph should be required reading for all persons en- 
gaged in attempts to use regression equations in the prediction of academic or 


vocational success. 
Max D. ENGELHART. 
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